-- Logs begin at Mon 2022-09-19 10:31:18 UTC, end at Mon 2022-09-19 12:16:43 UTC. -- Sep 19 11:16:00.102524 dv-cinder-822822-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 11:16:00.112414 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:16:00 2022] *** Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: nodename: dv-cinder-822822-7-iscsi Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: machine: x86_64 Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: clock source: unix Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: pcre jit disabled Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: detected number of CPU cores: 4 Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: current working directory: / Sep 19 11:16:00.114384 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:16:00.115076 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: your processes number limit is 47680 Sep 19 11:16:00.115076 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: your memory page size is 4096 bytes Sep 19 11:16:00.115076 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: detected max file descriptor number: 2048 Sep 19 11:16:00.115076 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: lock engine: pthread robust mutexes Sep 19 11:16:00.115076 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: thunder lock: enabled Sep 19 11:16:00.115076 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 11:16:00.115076 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:16:00.153198 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: Python main interpreter initialized at 0x5631e5ceb9c0 Sep 19 11:16:00.153198 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: python threads support enabled Sep 19 11:16:00.153198 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: your server socket listen backlog is limited to 100 connections Sep 19 11:16:00.153198 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:16:00.153656 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:16:00.153656 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: *** Operational MODE: preforking *** Sep 19 11:16:00.153871 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:16:00.153871 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: spawned uWSGI master process (pid: 106035) Sep 19 11:16:00.154048 dv-cinder-822822-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 11:16:00.155360 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: spawned uWSGI worker 1 (pid: 106036, cores: 1) Sep 19 11:16:00.155360 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: spawned uWSGI worker 2 (pid: 106037, cores: 1) Sep 19 11:16:00.155360 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:16:00.833486 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:16:00.874438 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:16:01.916293 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:16:01.916293 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: from cryptography.utils import int_from_bytes Sep 19 11:16:01.916926 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:16:01.916926 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: from cryptography.utils import int_from_bytes Sep 19 11:16:01.992382 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:16:01.992382 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: from cryptography.utils import int_from_bytes Sep 19 11:16:01.992982 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:16:01.992982 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: from cryptography.utils import int_from_bytes Sep 19 11:16:04.421431 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:16:04.421988 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:16:04.422146 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:16:04.422507 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:16:04.422767 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:16:04.423154 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.423502 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.423601 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:16:04.423982 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.424070 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:16:04.424158 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.424381 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:16:04.424480 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.424740 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.424857 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:16:04.425007 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:16:04.425152 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.425364 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.425468 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.425687 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.425803 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.425947 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.426074 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.426262 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.426370 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.426589 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-7-iscsi {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.426700 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.426905 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.426999 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.427248 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.427354 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.427558 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.427656 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.427876 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.427983 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.428176 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.428268 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.428495 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.428592 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.428798 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.428890 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-7-iscsi {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.429140 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.429290 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.429452 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.429739 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.429851 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.430044 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.430157 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.430354 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.430457 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.430682 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.430779 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.430996 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.431086 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.431332 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.431529 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.431639 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.431843 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.431943 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.432151 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.432249 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.432461 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.432559 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.432804 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.432937 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-7-iscsi {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.433121 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.433255 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.433437 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.433566 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.433763 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.433862 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.434079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.434274 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.434407 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.434584 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.434721 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.434892 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.435134 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-7-iscsi {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.435298 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.435479 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.435580 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.435800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.435902 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.436116 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.436532 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.436852 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.437162 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.437521 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.437647 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.437845 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.437982 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.438161 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.438265 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.438490 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.438577 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.438814 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.438907 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.439133 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.439254 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.439479 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.439576 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.439786 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.439873 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.440099 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.440192 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.440406 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.440492 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.440662 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.440756 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.440974 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.441071 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.441299 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.441401 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.441551 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.441642 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.441866 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.441965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.442185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.442296 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.442419 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.442507 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.442738 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.442834 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.443051 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.443149 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.443326 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.443423 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.443649 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.443745 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.443974 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.444062 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.444281 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.444371 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.444590 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.444733 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.444897 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.444983 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.445202 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.445295 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.445509 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.445615 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.445815 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.445907 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.446127 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.446212 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.446437 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.446534 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.446742 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.446834 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.447063 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.447156 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.447412 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.447518 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.447725 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.447811 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.448031 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.448162 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.448376 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.448470 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.448681 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.448767 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.448993 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.449080 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.449310 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.449396 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.449630 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.449716 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.449943 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.450050 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.450248 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.450337 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.450557 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.450650 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.450872 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.450964 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.451199 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.451291 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.451515 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.451612 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.451771 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.451865 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.452072 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.452173 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.452380 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.452486 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.452696 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.452794 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.453516 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.453610 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.453828 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.453968 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.454155 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.454263 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.454467 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.454553 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.454777 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.454876 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.455090 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.455214 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.455426 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.455514 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.455739 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.455824 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.456052 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.456159 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.456356 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.456442 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.456660 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.456746 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.456963 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.457057 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.457267 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.457354 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.457570 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.457657 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.457911 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.458005 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.458186 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.458274 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.458490 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.458584 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.458793 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.458882 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.459096 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.459212 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.459428 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.459523 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.459736 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.459829 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.460041 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.460133 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.460345 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.460432 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.460663 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.460750 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.460966 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.461060 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.461270 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.461356 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.461586 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.461724 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.461892 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.461988 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.462197 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.462290 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.462512 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.462609 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.462810 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.462905 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.463114 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.463228 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.463453 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.463560 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.463757 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.463842 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.464063 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.464160 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.464367 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.464454 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.464668 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.464764 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.464972 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.465089 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.465269 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.465356 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.465567 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.465653 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.465903 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.466007 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.466162 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.466249 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.466467 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.466553 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.466775 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.466871 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.467080 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.467196 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.467407 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.467504 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.467710 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.467805 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.468025 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.468112 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.468335 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.468431 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.469191 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.469291 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.469518 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:16:04.469606 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.469852 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.469938 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.470183 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.470278 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.470514 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.470600 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.470833 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.470920 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.471143 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.471297 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.471478 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.471577 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.471803 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.471903 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.472113 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.472205 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.472423 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.472515 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.472735 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.472834 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.473051 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.473144 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.473368 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.473455 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.473698 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.473871 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.474020 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.474115 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.474332 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.474432 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.474648 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.474744 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.474958 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.475090 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.475299 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.475400 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.475625 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.475758 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.475941 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.476028 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.476249 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.476341 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.476582 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.476682 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.476910 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.476998 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.477223 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.477316 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.477547 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.477647 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.477865 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.477951 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.478177 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.478262 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.478485 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.478580 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.478794 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.478882 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.479131 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.479238 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.479468 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.479565 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.479780 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.479881 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.480097 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.480191 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.480478 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.480617 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.480731 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.480819 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.481040 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.481141 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.481350 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.481438 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.481658 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.481753 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.481970 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.482065 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.482278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.482373 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.482591 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.482688 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.482907 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.483002 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.483246 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.483350 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.483564 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.483652 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.483881 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.483977 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.484219 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.484311 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.484531 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.484619 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.484841 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.484928 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.485454 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.485561 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.485758 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.485945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.486048 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.486138 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.486351 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.486445 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.486657 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.486745 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.486961 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.487061 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.487294 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.487395 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.487611 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.487700 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.487916 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.488004 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.488243 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.488336 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.488548 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.488635 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.488858 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.488946 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.489167 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.489253 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.489474 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.489570 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.489777 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.489868 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.490087 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.490181 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.490393 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.490488 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.490696 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.490785 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.491009 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.491094 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.491340 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.491442 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.491644 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.491740 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.491963 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.492050 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.492267 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.492362 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.492571 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.492671 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.492883 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.492972 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.493189 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.493286 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.493497 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.493582 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.493806 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.493894 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.494207 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.494297 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.494677 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.494771 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.495135 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.495358 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.495559 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.495770 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.495907 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.496107 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.496242 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.496431 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.496549 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.496832 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.496935 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.497096 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.497183 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.497437 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.497525 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.497751 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.497837 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.498075 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.498162 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.498379 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.498467 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.498681 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.498768 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.498990 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.499078 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.499336 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.499432 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.499639 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.499725 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.499967 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.500054 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.500270 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.500358 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.500570 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.500656 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.500870 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.500974 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.501175 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.501261 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.501483 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.501578 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.501783 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.501877 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.502086 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.502173 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.502390 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.502477 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.502708 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.502867 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.503018 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.503106 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.503357 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.503447 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.503666 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.503771 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.504013 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.504099 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.504324 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.504410 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.504633 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.504718 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.504947 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.505033 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.505255 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.505350 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.505565 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.505691 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.505876 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.506014 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.506187 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.506337 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.506503 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.506653 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.506812 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.506971 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.507130 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.507312 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.507461 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.507630 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.507783 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.507953 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.508095 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.508269 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.508412 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.508594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.508715 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.508909 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.509030 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.509239 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.509367 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.509557 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.509697 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.509881 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.510007 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.510191 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.510317 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.510511 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.510628 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.510856 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.510948 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.511218 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.511321 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.511544 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.511631 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.511849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.511934 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.512160 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.512248 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.512477 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.512564 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.512785 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.512880 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.513099 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.513185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.513404 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.513488 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.513719 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.513818 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.514031 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.514124 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.514343 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.514428 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.514642 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.514741 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.514954 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.515040 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.515305 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.515892 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.516147 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.516294 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.516461 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.516548 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.516769 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.516861 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.517087 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.517181 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.517396 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.517482 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.517701 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.517789 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.518009 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.518104 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.518313 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.518398 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.518615 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.518701 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.518923 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.519010 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.519259 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.519348 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.519569 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.519655 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.519877 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.519966 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.520178 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.520269 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.520489 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.520585 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.520794 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.520881 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.521096 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.521183 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.521396 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.521496 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.521703 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.521791 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.522021 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.522114 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.522328 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.522425 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.522636 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.522721 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.522943 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.523038 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.523267 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.523376 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.523573 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.523666 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.523891 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.523986 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.524199 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.524288 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.524508 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.524604 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.524810 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.524897 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.525111 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.525198 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.525439 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.525523 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.525751 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.525835 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.526054 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.526141 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.526363 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.526448 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.526674 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.526759 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.526978 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.527065 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.527317 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.527412 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.527624 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.527730 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.527932 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.528019 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.528248 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.528335 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.528560 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.528657 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.528867 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.528953 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.529173 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.529259 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.529479 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.529574 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.529786 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.529872 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.530091 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.530215 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.530411 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.530506 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.530714 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.530800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.531043 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.531129 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.531901 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.532003 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.532205 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.532304 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.532513 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.532600 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.532827 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.532917 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.533143 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.533400 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.533504 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.533730 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.533826 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.534043 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.534135 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.534366 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.534452 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.534708 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.534948 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.535049 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.535315 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.535405 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.535644 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.535743 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.535981 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.536082 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.536283 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.536369 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.536591 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.536686 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.536894 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.536982 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.537195 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.537290 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.537502 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.537613 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.537805 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.537929 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.538106 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.538249 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.538408 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.538565 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.538716 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.538878 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.539018 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.539219 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.539347 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.539537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.539654 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.539849 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.539957 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.540160 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.540270 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.540477 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.540566 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.540788 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.540875 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.541099 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.541186 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.541409 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.541508 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.541719 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.541814 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.542040 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.542126 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.542341 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.542428 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.542642 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.542730 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.542951 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.543036 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.543301 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.543403 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.543617 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.543703 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.543928 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.544022 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.544238 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.544334 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.544547 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.544633 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.544862 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.544947 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.545185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.545282 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.545490 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.545576 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.545793 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.545880 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.546093 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.546181 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.546398 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.546484 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.546749 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.546836 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.547052 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.547147 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.547387 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.547485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.547696 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.547782 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.548002 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.548089 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.548309 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.548392 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.548611 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.548704 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.548915 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.549010 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.549216 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.549302 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.549526 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.549621 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.549833 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.549927 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.550134 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.550220 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.550437 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.550532 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.550746 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.550832 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.551051 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.551145 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.551377 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.551485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.551686 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.551774 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.551988 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.552074 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.552293 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.552388 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.552592 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.552684 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.552892 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.552979 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.553193 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.553280 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.553498 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.553584 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.553805 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.553891 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.554103 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.554189 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.554421 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.554514 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.554727 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.554812 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.555028 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.555115 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.555352 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.555442 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.555658 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.555744 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.555959 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.556046 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.556260 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.556354 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.556563 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.556772 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.556866 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.556951 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.557172 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.557260 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.557469 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.557563 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.557775 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.557863 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.558078 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.558164 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.558381 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.558481 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.558682 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.558778 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.558985 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.559072 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.559308 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.559414 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.559609 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.559704 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.559909 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.559997 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.560212 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.560299 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.560514 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.560600 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.560825 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.560911 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.561127 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.561213 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.561428 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.561513 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.561728 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.561830 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.562028 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.562122 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.562357 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.562449 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.562683 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.562778 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.562998 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.563093 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.563330 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.563433 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.563642 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.563742 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.563950 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.564036 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.564258 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.564350 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.564571 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.564666 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.564928 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.565119 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.565205 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.565284 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.565489 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.565586 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.565799 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.565887 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.566113 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.566209 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.566414 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.566509 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.566718 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.566821 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.567037 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.567132 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.567372 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.567466 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.567710 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.567802 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.567998 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.568075 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569238 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569238 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569238 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569596 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569686 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569774 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569896 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.569896 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.570058 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.570249 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.570350 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.570432 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.570519 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.570716 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.570804 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.571026 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.571114 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.571360 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.571469 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.571670 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.571757 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.571977 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.572065 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.572512 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.572614 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.572698 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.572776 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.572879 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.572967 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.573182 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.573271 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.573505 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.573592 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.573810 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.573914 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.574111 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.574199 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.574422 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.574508 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.574722 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.574822 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.575028 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.575116 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.575353 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.575442 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.575666 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.575765 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.575975 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.576068 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.576302 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.576397 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.576619 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.576715 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.576928 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.577014 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.577242 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.577335 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.577550 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.577647 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.578360 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.578454 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.578678 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.578772 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.579093 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.579206 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.579432 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.579519 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.579744 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.579842 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.580053 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.580147 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.580354 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.580439 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.580686 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.580786 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.580962 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.581049 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.581279 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.581363 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.581579 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.581666 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.581882 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.581998 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.582183 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.582314 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.582503 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.582629 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.582806 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.582943 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.583125 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.583273 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.583561 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.583660 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.583869 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.583964 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.584175 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.584269 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.584487 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.584583 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.584795 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.584883 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.585104 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.585198 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.585429 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.585524 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.585738 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.585824 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.586065 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.586150 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.586393 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.586554 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.586707 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.586807 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.587016 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.587102 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.587362 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.587519 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.587685 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.587833 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.587996 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.588147 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.588308 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.588473 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.588610 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.588798 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.588929 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.589127 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.589250 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.589438 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.589565 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.589757 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.589886 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.590063 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.590297 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.590434 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.590620 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.590709 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.590931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.591021 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.591273 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.591377 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.591597 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.591686 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.591902 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.592003 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.592204 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.592305 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.592511 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.592600 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.592815 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.592902 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.593118 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.593277 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.593438 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.593662 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.594293 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.594481 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.594605 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.594811 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.594906 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.595143 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.595299 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.595478 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.595566 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.595790 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.595892 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.596106 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.596193 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.596416 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.596512 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.596725 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.596813 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.597039 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.597124 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.597354 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.597512 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.597671 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.597766 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.597975 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.598069 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.598286 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.598381 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.598668 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.598777 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.598895 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.598983 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.599216 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.599341 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.599522 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.599610 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.599859 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.599946 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.600162 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.600256 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.600479 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.600566 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.600805 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.600940 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.601116 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.601205 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.601420 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.601513 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.601744 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.601830 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.602054 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.602149 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.602361 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.602456 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.602666 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.602751 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.602982 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.603071 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.603324 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.603414 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.603627 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.603728 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.603928 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.604026 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.604235 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.604329 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.604538 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.604634 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.604845 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.604932 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.605146 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.605232 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.605453 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.605548 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.605752 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.605839 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.606056 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.606144 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.606356 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.606451 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.606673 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.606760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.606974 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.607062 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.607317 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.607410 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.607624 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.607723 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.607925 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.608013 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.608274 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.608378 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.608528 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.608625 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.608849 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.608942 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.609180 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.609273 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.609486 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.609573 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.609798 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.609887 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.610362 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.610455 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.610677 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.610763 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.610987 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.611087 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.611318 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.611408 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.611629 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.611705 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.611935 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.621816 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.621816 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622047 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622161 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622243 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622321 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622401 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622469 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622546 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622623 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622701 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622787 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622875 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.622875 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623018 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623096 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623196 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623293 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623382 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623462 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623547 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623628 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623714 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623803 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623883 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.623961 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624038 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624115 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624192 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624278 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624365 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624444 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624522 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624522 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624648 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624746 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624830 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624908 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.624986 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625072 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625161 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625241 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625327 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625408 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625486 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625572 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625662 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625742 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625819 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.625917 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626004 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626096 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626181 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626340 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626425 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626512 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626595 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626682 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626762 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626840 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.626917 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627002 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627082 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627191 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627313 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627456 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627543 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627629 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627717 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627797 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.627924 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628050 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628139 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628223 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628311 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628391 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628469 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628547 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628624 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628710 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628789 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628866 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.628944 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629021 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629098 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629191 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629279 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629359 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629437 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629514 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629599 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629755 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629845 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629925 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.629999 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630078 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630164 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630233 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630317 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630396 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630481 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630560 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630646 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630726 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630846 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.630934 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631014 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631092 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631203 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631274 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631352 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631432 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631432 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631574 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631660 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631748 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631828 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631894 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.631959 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632031 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632098 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632175 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632260 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632340 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632417 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632502 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632502 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632641 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632708 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632784 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632868 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.632960 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.633046 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.633125 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.633273 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.633403 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.633583 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.633719 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.633912 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.634032 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.634228 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.634352 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.634539 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.634657 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.634863 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.634950 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.635192 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.635329 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.635586 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.635750 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.635947 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.636155 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.636242 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.636480 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.636576 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.636818 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.636913 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.637129 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.637215 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.637438 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.637535 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.637740 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.637836 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.638064 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.638151 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.638367 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.638455 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.638668 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.638754 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.638971 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.639059 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.639312 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.639402 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.639615 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.639713 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.639917 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.640004 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.640220 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.640309 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.641040 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.641136 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.641346 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.641484 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.641648 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.641745 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.641958 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.642098 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.642258 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.642356 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.642566 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.642656 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.642874 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.642961 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.643201 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.643305 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.643521 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.643608 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.643830 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.643926 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.644138 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.644237 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.644442 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.644529 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.644822 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.644920 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.645059 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.645155 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.645364 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.645450 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.645677 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.645771 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.645981 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.646069 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.646296 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.646384 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.646625 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.646710 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.646954 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.647160 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.647273 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.647523 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.647609 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.647845 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.647950 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.648179 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.648275 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.648502 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.648612 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.648807 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.648904 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.649114 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.649201 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.649418 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.649506 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.649738 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.649826 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.650046 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.650134 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.650357 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.650446 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.650666 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.650923 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.651017 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.651288 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.651394 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.651596 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.651695 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.651904 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.651991 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.652210 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.652300 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.652516 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.652605 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.652821 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.652909 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.653125 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.653213 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.653429 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.653518 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.653735 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.653830 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.654040 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.654354 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.654443 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.654665 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.654750 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.654979 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.655074 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.655321 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.655423 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.655635 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.655721 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.655948 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.656149 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.656792 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.656886 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.657103 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.657190 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.657412 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.657509 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.657720 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.657806 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.658030 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.658124 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.658343 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.658444 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.658656 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.658750 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.658964 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.659051 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.659338 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.659665 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.659751 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.659979 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.660065 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.660299 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.660395 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.660614 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.660702 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.660921 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.661006 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.661233 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.661327 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.661546 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.661633 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.661856 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.661941 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.662175 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.662313 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.662487 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.662582 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.662794 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.662888 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.663141 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.663517 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.663609 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.663843 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.663933 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.664166 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.664262 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.664470 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.664557 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.664780 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.664876 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.665088 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.665177 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.665404 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.665490 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.665710 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.665797 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.666012 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.666101 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.666314 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.666400 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.666621 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.666707 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.666924 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.667012 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.667518 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.667615 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.667831 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.667932 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.668133 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.668221 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.668440 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.668527 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.668740 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.668837 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.669043 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.669131 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.669344 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.669440 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.669646 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.669744 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.669948 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.670036 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.670250 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.670337 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.670557 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.670654 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.670860 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.670949 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.671158 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.671302 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.671530 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.671645 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.671814 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.671909 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.672117 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.672206 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.672439 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.672526 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.672747 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.672834 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.673053 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.673186 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.673361 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.673457 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.673667 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.673755 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.673973 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.674062 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.674286 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.674374 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.674593 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.674681 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.674900 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.674997 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.675228 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.675319 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.675534 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.675659 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.675838 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.675938 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.676163 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.676249 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.676471 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.676566 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.676781 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.676877 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.677090 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.677185 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.677396 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.677483 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.677701 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.677800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.678027 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.678113 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.678351 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.678437 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.678652 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.678739 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.678977 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.679063 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.679315 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.679403 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.679630 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.679718 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.679941 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.680037 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.680252 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.680347 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.680569 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.680656 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.680876 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.680962 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.681185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.681285 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.681494 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.681584 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.681801 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.681896 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.682110 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.682206 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.682423 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.682511 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.682729 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.682816 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.683037 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.683133 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.683375 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.683465 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.683687 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.683804 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.684042 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.684131 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.684369 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.684454 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.684678 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.684774 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.684993 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.685081 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.685310 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.685397 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.685628 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.685716 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.685946 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.686036 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.686265 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.686360 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.686587 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.686691 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.686903 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.687038 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.687256 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.687362 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.687562 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.687661 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.687804 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106036) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:16:04.687892 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.688214 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.688529 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.688859 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.689190 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.689542 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.689861 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.690212 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.690547 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.690868 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.691204 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.691522 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:16:04.691771 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106037) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:16:04.840460 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO dbcounter [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Registered counter for database nova_api Sep 19 11:16:04.844118 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO dbcounter [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Registered counter for database nova_api Sep 19 11:16:04.861663 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_db.sqlalchemy.engines [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:04.864857 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:04.868303 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writer thread running {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:04.871569 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writer thread running {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:04.924848 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.context [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f81a8dc-976d-4306-9181-384261ba6896(cell1) {{(pid=106036) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:16:04.928500 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.context [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f81a8dc-976d-4306-9181-384261ba6896(cell1) {{(pid=106037) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:16:04.928644 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:16:04.929116 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:16:04.930648 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:16:04.931401 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:16:04.931850 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:16:04.932370 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_concurrency.lockutils [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:16:04.932848 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_concurrency.lockutils [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:16:04.933804 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:16:04.934423 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_concurrency.lockutils [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:16:04.935220 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_concurrency.lockutils [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:16:04.935674 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_concurrency.lockutils [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:16:04.935784 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO dbcounter [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Registered counter for database nova_cell0 Sep 19 11:16:04.938184 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_concurrency.lockutils [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106037) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:16:04.940287 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO dbcounter [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Registered counter for database nova_cell0 Sep 19 11:16:04.940420 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO dbcounter [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Registered counter for database nova_cell1 Sep 19 11:16:04.944406 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO dbcounter [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Registered counter for database nova_cell1 Sep 19 11:16:04.949725 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_db.sqlalchemy.engines [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:04.950903 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_db.sqlalchemy.engines [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:04.951630 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:04.954221 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:04.958108 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writer thread running {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:04.959585 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writer thread running {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:04.961069 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writer thread running {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:04.962591 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writer thread running {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:05.107209 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO dbcounter [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Registered counter for database nova_cell0 Sep 19 11:16:05.118216 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_db.sqlalchemy.engines [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106036) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:05.119998 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO dbcounter [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Registered counter for database nova_cell0 Sep 19 11:16:05.123119 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writer thread running {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:05.129996 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG oslo_db.sqlalchemy.engines [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106037) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:16:05.134404 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writer thread running {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:16:05.585125 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: WARNING keystonemiddleware.auth_token [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:16:05.592456 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: WARNING keystonemiddleware.auth_token [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:16:05.601871 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: WARNING keystonemiddleware.auth_token [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:16:05.609045 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: WARNING keystonemiddleware.auth_token [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:16:05.934533 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: WARNING keystonemiddleware.auth_token [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:16:05.940498 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: WARNING keystonemiddleware.auth_token [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:16:05.945797 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5631e5ceb9c0 pid: 106036 (default app) Sep 19 11:16:05.947914 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:16:05.948907 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: WARNING keystonemiddleware.auth_token [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:16:05.949109 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] 10.222.0.78 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001779 Sep 19 11:16:05.949530 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 1/1] 10.222.0.78 () {50 vars in 788 bytes} [Mon Sep 19 11:16:05 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:16:05.955679 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: WARNING keystonemiddleware.auth_token [None req-bd2ef467-b2b1-47df-a205-6158d72e9646 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:16:05.961053 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5631e5ceb9c0 pid: 106037 (default app) Sep 19 11:17:31.987149 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:31.988880 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002265 Sep 19 11:17:31.989516 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 2/2] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:32.006046 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writing DB stats nova_api:SELECT=3 {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:32.007921 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writing DB stats nova_cell1:SELECT=3 {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:32.009233 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writing DB stats nova_cell0:SELECT=3 {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:32.010461 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:33.032597 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-8f03e928-6719-4167-ae09-b140a0bcb3a6 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:33.066015 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-8f03e928-6719-4167-ae09-b140a0bcb3a6 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.069360 Sep 19 11:17:33.066752 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 1/3] 10.222.0.78 () {60 vars in 1292 bytes} [Mon Sep 19 11:17:31 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1071 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:35.718073 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:35.718976 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-2944b193-8ba5-454c-b8de-aebaa0ac7d59 None None] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001404 Sep 19 11:17:35.719574 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 3/4] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:36.188432 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-3cab9d36-1028-4d71-882f-2af8d6e00932 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "id": "c1", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "disk": 1}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:36.349872 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-3cab9d36-1028-4d71-882f-2af8d6e00932 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.623914 Sep 19 11:17:36.350447 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 2/5] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:17:35 2022] POST /compute/v2.1/flavors => generated 407 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:17:36.367739 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_api:SELECT=3 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:36.368659 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_cell0:SELECT=3 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:36.372611 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_cell1:SELECT=3 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:36.373479 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:17:36.583472 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-bd068449-a146-4c96-a787-1a2523bac77d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:36.740095 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-bd068449-a146-4c96-a787-1a2523bac77d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.379631 Sep 19 11:17:36.740696 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 4/6] 10.222.0.78 () {64 vars in 1336 bytes} [Mon Sep 19 11:17:36 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:39.388533 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-3cab9d36-1028-4d71-882f-2af8d6e00932 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:39.389755 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-3cab9d36-1028-4d71-882f-2af8d6e00932 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001725 Sep 19 11:17:39.390269 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 3/7] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:40.104685 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-95914db5-eea6-47c7-9a0a-55494b4e9829 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "id": "d1", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:40.225689 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-95914db5-eea6-47c7-9a0a-55494b4e9829 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.828841 Sep 19 11:17:40.226369 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 5/8] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:17:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:17:40.238618 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-a0b16543-3c50-40d7-bf18-033f81bf787b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:40.362064 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-a0b16543-3c50-40d7-bf18-033f81bf787b admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.119220 Sep 19 11:17:40.362064 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 4/9] 10.222.0.78 () {64 vars in 1336 bytes} [Mon Sep 19 11:17:40 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:43.008650 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-95914db5-eea6-47c7-9a0a-55494b4e9829 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:43.009789 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-95914db5-eea6-47c7-9a0a-55494b4e9829 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001586 Sep 19 11:17:43.010222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 6/10] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:43 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:17:43.458702 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-8eeb65c7-ff7d-4295-905b-77334b9f13c8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "name": "ds1G", "vcpus": 1}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:43.574033 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-8eeb65c7-ff7d-4295-905b-77334b9f13c8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.557364 Sep 19 11:17:43.574513 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 5/11] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:17:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:17:43.587597 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-b64ceaf1-104a-48c5-b245-c690eaf68c8a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:43.722117 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-b64ceaf1-104a-48c5-b245-c690eaf68c8a admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.138357 Sep 19 11:17:43.722947 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 7/12] 10.222.0.78 () {64 vars in 1336 bytes} [Mon Sep 19 11:17:43 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:46.394369 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-8eeb65c7-ff7d-4295-905b-77334b9f13c8 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:46.395408 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-8eeb65c7-ff7d-4295-905b-77334b9f13c8 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 19 11:17:46.395801 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 6/13] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:46.843852 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-abea9d05-4686-48ca-b1a8-28c01703c772 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3", "disk": 10, "vcpus": 2, "ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:46.940680 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-abea9d05-4686-48ca-b1a8-28c01703c772 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.538197 Sep 19 11:17:46.941436 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 8/14] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:17:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:17:46.953845 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-211de942-2a57-49d4-829b-a1fd980925b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:47.081205 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-211de942-2a57-49d4-829b-a1fd980925b8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131529 Sep 19 11:17:47.081917 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 7/15] 10.222.0.78 () {64 vars in 1336 bytes} [Mon Sep 19 11:17:46 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:49.731578 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-abea9d05-4686-48ca-b1a8-28c01703c772 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:49.732833 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-abea9d05-4686-48ca-b1a8-28c01703c772 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001797 Sep 19 11:17:49.733234 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 9/16] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:49 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:50.173465 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-cf38538d-7dfc-454a-bf35-de7b4067b350 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "id": "d4", "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "name": "ds4G", "os-flavor-access:is_public": true, "vcpus": 4}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:50.269579 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-cf38538d-7dfc-454a-bf35-de7b4067b350 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.529552 Sep 19 11:17:50.270300 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 8/17] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:17:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:17:50.285756 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-cadd5856-4958-4729-9c04-57e2cb50c03e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:50.386172 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-cadd5856-4958-4729-9c04-57e2cb50c03e admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.105440 Sep 19 11:17:50.387142 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 10/18] 10.222.0.78 () {64 vars in 1336 bytes} [Mon Sep 19 11:17:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:53.347819 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-cf38538d-7dfc-454a-bf35-de7b4067b350 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:53.349159 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-cf38538d-7dfc-454a-bf35-de7b4067b350 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002005 Sep 19 11:17:53.349699 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 9/19] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:17:53.841013 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-0105bbb9-95e9-4fa6-8289-75f2eb9dcce2 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:53.867981 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-0105bbb9-95e9-4fa6-8289-75f2eb9dcce2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.509405 Sep 19 11:17:53.868528 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 11/20] 10.222.0.78 () {60 vars in 1292 bytes} [Mon Sep 19 11:17:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:17:56.511120 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-cf38538d-7dfc-454a-bf35-de7b4067b350 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:56.512178 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-cf38538d-7dfc-454a-bf35-de7b4067b350 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 19 11:17:56.512595 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 10/21] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:17:56.920851 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-e0a96398-8b01-4f58-928c-3614136aaf85 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "1", "disk": 1, "ram": 512}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:57.010959 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-e0a96398-8b01-4f58-928c-3614136aaf85 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.491392 Sep 19 11:17:57.011538 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 12/22] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:17:56 2022] POST /compute/v2.1/flavors => generated 402 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:17:57.023569 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-09ef11fa-5c52-416b-98f8-e050e93f8a0f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:17:57.115053 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-09ef11fa-5c52-416b-98f8-e050e93f8a0f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094963 Sep 19 11:17:57.115785 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 11/23] 10.222.0.78 () {64 vars in 1333 bytes} [Mon Sep 19 11:17:57 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:17:59.749849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-e0a96398-8b01-4f58-928c-3614136aaf85 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:17:59.750871 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-e0a96398-8b01-4f58-928c-3614136aaf85 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 19 11:17:59.751295 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 13/24] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:17:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:00.128062 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-a4b5aa65-b2e9-4a1f-9da2-915994f84ab8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "name": "m1.small", "swap": 0, "disk": 20, "vcpus": 1, "rxtx_factor": 1.0, "id": "2", "os-flavor-access:is_public": true}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:00.229947 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-a4b5aa65-b2e9-4a1f-9da2-915994f84ab8 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.472325 Sep 19 11:18:00.230428 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 12/25] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:17:59 2022] POST /compute/v2.1/flavors => generated 405 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:00.242758 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-df0a9763-c860-4b34-92b1-5753a31886a0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:00.376613 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-df0a9763-c860-4b34-92b1-5753a31886a0 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.137453 Sep 19 11:18:00.377223 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 14/26] 10.222.0.78 () {64 vars in 1333 bytes} [Mon Sep 19 11:18:00 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:18:03.037275 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-a4b5aa65-b2e9-4a1f-9da2-915994f84ab8 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:03.038294 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-a4b5aa65-b2e9-4a1f-9da2-915994f84ab8 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 19 11:18:03.038699 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 13/27] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:18:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:03.491132 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-6a4f1c40-36f1-448c-bb7c-6ba7663ba885 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2, "swap": 0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:03.590655 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-6a4f1c40-36f1-448c-bb7c-6ba7663ba885 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.545387 Sep 19 11:18:03.591493 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 15/28] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:18:03 2022] POST /compute/v2.1/flavors => generated 406 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:03.603896 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-01605cad-5d67-4bfc-99e3-3f9d1017092c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:03.609290 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:03.779561 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-01605cad-5d67-4bfc-99e3-3f9d1017092c admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.179302 Sep 19 11:18:03.781172 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 14/29] 10.222.0.78 () {64 vars in 1333 bytes} [Mon Sep 19 11:18:03 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:18:06.484766 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-6a4f1c40-36f1-448c-bb7c-6ba7663ba885 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:06.485874 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-6a4f1c40-36f1-448c-bb7c-6ba7663ba885 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 19 11:18:06.486303 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 16/30] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:18:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:06.961358 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-6689d699-54c5-4983-89ba-09a2b2d8f123 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "ram": 8192, "swap": 0, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "disk": 80, "os-flavor-access:is_public": true}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:07.527124 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-6689d699-54c5-4983-89ba-09a2b2d8f123 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.034215 Sep 19 11:18:07.528509 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 15/31] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:18:06 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:07.541147 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-15ae8128-9006-4334-9fc1-977f1e78ca20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:07.736975 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-15ae8128-9006-4334-9fc1-977f1e78ca20 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.199742 Sep 19 11:18:07.737678 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 17/32] 10.222.0.78 () {64 vars in 1333 bytes} [Mon Sep 19 11:18:07 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:18:10.415096 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-6689d699-54c5-4983-89ba-09a2b2d8f123 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:10.416166 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-6689d699-54c5-4983-89ba-09a2b2d8f123 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 19 11:18:10.416567 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 16/33] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:18:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:10.855117 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-541a3ca9-3398-4464-8f5c-d63a09194428 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 16384}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:10.864296 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:10.996644 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-541a3ca9-3398-4464-8f5c-d63a09194428 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.572303 Sep 19 11:18:10.998010 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 18/34] 10.222.0.78 () {64 vars in 1283 bytes} [Mon Sep 19 11:18:10 2022] POST /compute/v2.1/flavors => generated 408 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:11.009881 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-24d35476-a4b6-44e3-bf14-cc5333ca6420 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:11.148010 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-24d35476-a4b6-44e3-bf14-cc5333ca6420 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.141622 Sep 19 11:18:11.148807 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 17/35] 10.222.0.78 () {64 vars in 1333 bytes} [Mon Sep 19 11:18:11 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:18:27.517343 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-541a3ca9-3398-4464-8f5c-d63a09194428 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:27.566162 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-541a3ca9-3398-4464-8f5c-d63a09194428 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 19 11:18:27.566162 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 19/36] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:18:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:27.566813 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:18:27.924917 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-162a644d-b669-4673-93a1-0d1b21b02ee7 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:27.944169 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-162a644d-b669-4673-93a1-0d1b21b02ee7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.419260 Sep 19 11:18:27.944715 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 18/37] 10.222.0.78 () {60 vars in 1292 bytes} [Mon Sep 19 11:18:27 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:18:29.303509 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-541a3ca9-3398-4464-8f5c-d63a09194428 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:29.304527 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-541a3ca9-3398-4464-8f5c-d63a09194428 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Sep 19 11:18:29.304957 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 20/38] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:29.865966 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-18f9b405-c00c-4bc0-97ef-d79200802648 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:29.871330 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.wsgi [None req-18f9b405-c00c-4bc0-97ef-d79200802648 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-18f9b405-c00c-4bc0-97ef-d79200802648 admin admin] Request method failure captured: Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Accept: application/json Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Accept-Encoding: gzip, deflate Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Connection: keep-alive Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Content-Length: 0 Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Host: 10.222.0.78 Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Openstack-Api-Version: compute 2.92 Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Openstack-System-Scope: None Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: User-Agent: python-novaclient Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Auth-Token: gAAAAABjKFAFmc3uNlIgi7Sl6fO-H6DUeofvhGj0OtJ_068P4TMKeQz3xvj1X9Vaw_VaeB_blBAhN1sRU2ojsNqNU9ApNdEl98x2fkIDHVHrRNdklhyaTOjXtm9WoZRPpPoUzWCz1u5c1afSLr5y0vPesN5aZvzngwV9Ks8pVWkavjk5-BUjNdI Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Domain-Id: None Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Domain-Name: None Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Identity-Status: Confirmed Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Is-Admin-Project: True Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Domain-Id: default Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Domain-Name: Default Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Name: admin Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Role: admin,reader,member Sep 19 11:18:29.875105 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Roles: admin,reader,member Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant: admin Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant-Name: admin Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User: admin Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Domain-Id: default Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Domain-Name: Default Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Id: b83cd9cf7ce84815942f0d89b245aefe Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Name: admin Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: method: > Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: exception: Flavor 42 could not be found. Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: action_args: {'id': '42'} Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:18:29.876800 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:29.877760 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.878945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-18f9b405-c00c-4bc0-97ef-d79200802648 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:18:29.880339 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-18f9b405-c00c-4bc0-97ef-d79200802648 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.429967 Sep 19 11:18:29.880339 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 19/39] 10.222.0.78 () {60 vars in 1190 bytes} [Mon Sep 19 11:18:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:29.886620 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-bc094924-6c40-465d-b003-8e08c286726a admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:29.909835 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-bc094924-6c40-465d-b003-8e08c286726a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026842 Sep 19 11:18:29.915678 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 21/40] 10.222.0.78 () {60 vars in 1210 bytes} [Mon Sep 19 11:18:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:18:29.921841 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-5224c498-0a1b-4119-907b-38b6d3eb9d15 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:29.944515 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-5224c498-0a1b-4119-907b-38b6d3eb9d15 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027634 Sep 19 11:18:29.945055 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 20/41] 10.222.0.78 () {60 vars in 1210 bytes} [Mon Sep 19 11:18:29 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:18:29.954522 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-f6d55b9a-e092-49f9-b9dd-dfa3bb322a60 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:29.960406 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.wsgi [None req-f6d55b9a-e092-49f9-b9dd-dfa3bb322a60 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-f6d55b9a-e092-49f9-b9dd-dfa3bb322a60 admin admin] Request method failure captured: Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Accept: application/json Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Accept-Encoding: gzip, deflate Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Connection: keep-alive Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Content-Length: 0 Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Host: 10.222.0.78 Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Openstack-Api-Version: compute 2.92 Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Openstack-System-Scope: None Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: User-Agent: python-novaclient Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Auth-Token: gAAAAABjKFAFmc3uNlIgi7Sl6fO-H6DUeofvhGj0OtJ_068P4TMKeQz3xvj1X9Vaw_VaeB_blBAhN1sRU2ojsNqNU9ApNdEl98x2fkIDHVHrRNdklhyaTOjXtm9WoZRPpPoUzWCz1u5c1afSLr5y0vPesN5aZvzngwV9Ks8pVWkavjk5-BUjNdI Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Domain-Id: None Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Domain-Name: None Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Identity-Status: Confirmed Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Is-Admin-Project: True Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Domain-Id: default Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Domain-Name: Default Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Name: admin Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Role: admin,reader,member Sep 19 11:18:29.963676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Roles: admin,reader,member Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant: admin Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant-Name: admin Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User: admin Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Domain-Id: default Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Domain-Name: Default Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Id: b83cd9cf7ce84815942f0d89b245aefe Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Name: admin Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: method: > Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: exception: Flavor 42 could not be found. Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: action_args: {'id': '42'} Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:18:29.968931 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:29.969965 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:29.971288 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-f6d55b9a-e092-49f9-b9dd-dfa3bb322a60 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:18:29.972533 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-f6d55b9a-e092-49f9-b9dd-dfa3bb322a60 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014171 Sep 19 11:18:29.972533 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 22/42] 10.222.0.78 () {60 vars in 1190 bytes} [Mon Sep 19 11:18:29 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:31.319109 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-5224c498-0a1b-4119-907b-38b6d3eb9d15 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:31.320157 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-5224c498-0a1b-4119-907b-38b6d3eb9d15 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 19 11:18:31.320558 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 21/43] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:31 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:18:31.845164 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-d48d9243-814f-4316-83e3-8875094d0a6a admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:31.850547 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.wsgi [None req-d48d9243-814f-4316-83e3-8875094d0a6a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-d48d9243-814f-4316-83e3-8875094d0a6a admin admin] Request method failure captured: Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Accept: application/json Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Accept-Encoding: gzip, deflate Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Connection: keep-alive Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Content-Length: 0 Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Host: 10.222.0.78 Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Openstack-Api-Version: compute 2.92 Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Openstack-System-Scope: None Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: User-Agent: python-novaclient Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Auth-Token: gAAAAABjKFAH0fQRz-sLnCyU8PTUs1s8ofGZbjvDf5AnEspX65sInA-90J9hGIGrAmbZk8jDm52XBkAv950Ek4XVgKc2R-38pJBVMoUOwBzgB9nm9VMotV-3ZJX2_01Q9pxwwCrdE_IY8Cmlgbr7a6CrJf0X3LwfZgPjbz4cS2lr_tyjxW05x9g Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Domain-Id: None Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Domain-Name: None Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Identity-Status: Confirmed Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Is-Admin-Project: True Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Domain-Id: default Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Domain-Name: Default Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Name: admin Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Role: admin,reader,member Sep 19 11:18:31.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Roles: admin,reader,member Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant: admin Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant-Name: admin Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User: admin Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Domain-Id: default Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Domain-Name: Default Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Id: b83cd9cf7ce84815942f0d89b245aefe Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Name: admin Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: method: > Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: exception: Flavor 84 could not be found. Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: action_args: {'id': '84'} Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:18:31.853637 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:31.854617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-d48d9243-814f-4316-83e3-8875094d0a6a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:18:31.857465 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-d48d9243-814f-4316-83e3-8875094d0a6a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.393679 Sep 19 11:18:31.857465 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 23/44] 10.222.0.78 () {60 vars in 1190 bytes} [Mon Sep 19 11:18:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 395 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:31.864466 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-44d4b013-5561-41da-9f0c-402f71e9c90a admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:31.880099 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-44d4b013-5561-41da-9f0c-402f71e9c90a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019255 Sep 19 11:18:31.880671 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 22/45] 10.222.0.78 () {60 vars in 1210 bytes} [Mon Sep 19 11:18:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:18:31.890572 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-177c761b-039c-450a-8d34-2000b26f1df2 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:31.906574 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-177c761b-039c-450a-8d34-2000b26f1df2 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019656 Sep 19 11:18:31.910917 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 24/46] 10.222.0.78 () {60 vars in 1210 bytes} [Mon Sep 19 11:18:31 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:18:31.919342 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-b3335c7d-4cc1-4f7c-b1cf-3e6a3bf9cc1e admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:31.924972 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.wsgi [None req-b3335c7d-4cc1-4f7c-b1cf-3e6a3bf9cc1e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-b3335c7d-4cc1-4f7c-b1cf-3e6a3bf9cc1e admin admin] Request method failure captured: Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Accept: application/json Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Accept-Encoding: gzip, deflate Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Connection: keep-alive Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Content-Length: 0 Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Host: 10.222.0.78 Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Openstack-Api-Version: compute 2.92 Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Openstack-System-Scope: None Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: User-Agent: python-novaclient Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Auth-Token: gAAAAABjKFAH0fQRz-sLnCyU8PTUs1s8ofGZbjvDf5AnEspX65sInA-90J9hGIGrAmbZk8jDm52XBkAv950Ek4XVgKc2R-38pJBVMoUOwBzgB9nm9VMotV-3ZJX2_01Q9pxwwCrdE_IY8Cmlgbr7a6CrJf0X3LwfZgPjbz4cS2lr_tyjxW05x9g Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Domain-Id: None Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Domain-Name: None Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Identity-Status: Confirmed Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Is-Admin-Project: True Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Domain-Id: default Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Domain-Name: Default Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Name: admin Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Role: admin,reader,member Sep 19 11:18:31.926537 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Roles: admin,reader,member Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant: admin Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant-Name: admin Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User: admin Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Domain-Id: default Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Domain-Name: Default Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Id: b83cd9cf7ce84815942f0d89b245aefe Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Name: admin Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: method: > Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: exception: Flavor 84 could not be found. Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: action_args: {'id': '84'} Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:18:31.928165 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:31.929196 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:31.930594 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-b3335c7d-4cc1-4f7c-b1cf-3e6a3bf9cc1e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:18:31.931894 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-b3335c7d-4cc1-4f7c-b1cf-3e6a3bf9cc1e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012219 Sep 19 11:18:31.931894 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 23/47] 10.222.0.78 () {60 vars in 1190 bytes} [Mon Sep 19 11:18:31 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 19 11:18:33.158377 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-177c761b-039c-450a-8d34-2000b26f1df2 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:33.159409 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-177c761b-039c-450a-8d34-2000b26f1df2 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001431 Sep 19 11:18:33.159804 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 25/48] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:33.685011 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-1808fd44-5f7e-4073-a6d4-2b39acb1ab55 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:33.691365 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.wsgi [None req-1808fd44-5f7e-4073-a6d4-2b39acb1ab55 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-1808fd44-5f7e-4073-a6d4-2b39acb1ab55 admin admin] Request method failure captured: Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Accept: application/json Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Accept-Encoding: gzip, deflate Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Connection: keep-alive Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Content-Length: 0 Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Host: 10.222.0.78 Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Openstack-Api-Version: compute 2.92 Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Openstack-System-Scope: None Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: User-Agent: python-novaclient Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Auth-Token: gAAAAABjKFAJk-bx-jMErRJfqlybeOAKMof-xobYx8fbSTdtWuxEkhrfB5KBpWH1_kwVt1_QLef_KYNRPsatfoncPnE0eIs9uvzM1fDXbsy8fi4DwZ860Nn6PEDUpOt0sgJwAnHILWNMgoEQi36nYK3VIHN2gMj-1WWguQ8nwy7U_RfaPJvUPzA Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Domain-Id: None Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Domain-Name: None Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Identity-Status: Confirmed Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Is-Admin-Project: True Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Domain-Id: default Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Domain-Name: Default Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Project-Name: admin Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Role: admin,reader,member Sep 19 11:18:33.692854 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Roles: admin,reader,member Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant: admin Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-Tenant-Name: admin Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User: admin Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Domain-Id: default Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Domain-Name: Default Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Id: b83cd9cf7ce84815942f0d89b245aefe Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: X-User-Name: admin Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: method: > Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: exception: Flavor 451 could not be found. Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: action_args: {'id': '451'} Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:18:33.694384 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:33.695485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.697079 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-1808fd44-5f7e-4073-a6d4-2b39acb1ab55 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106037) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:18:33.698485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-1808fd44-5f7e-4073-a6d4-2b39acb1ab55 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.398990 Sep 19 11:18:33.698485 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 24/49] 10.222.0.78 () {60 vars in 1193 bytes} [Mon Sep 19 11:18:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 400 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:33.704199 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-aa5b98dc-1e97-429a-b7ed-b9753ed847bf admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:33.719513 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-aa5b98dc-1e97-429a-b7ed-b9753ed847bf admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018920 Sep 19 11:18:33.720060 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 26/50] 10.222.0.78 () {60 vars in 1210 bytes} [Mon Sep 19 11:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:18:33.729824 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:33.745460 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019192 Sep 19 11:18:33.746019 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 25/51] 10.222.0.78 () {60 vars in 1210 bytes} [Mon Sep 19 11:18:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:18:33.757734 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-3f40de9e-de6e-47ae-a9ce-7a65b8eeed2e admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:33.762733 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.wsgi [None req-3f40de9e-de6e-47ae-a9ce-7a65b8eeed2e admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-3f40de9e-de6e-47ae-a9ce-7a65b8eeed2e admin admin] Request method failure captured: Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Accept: application/json Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Accept-Encoding: gzip, deflate Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Connection: keep-alive Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Content-Length: 0 Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Host: 10.222.0.78 Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Openstack-Api-Version: compute 2.92 Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Openstack-System-Scope: None Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: User-Agent: python-novaclient Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Auth-Token: gAAAAABjKFAJk-bx-jMErRJfqlybeOAKMof-xobYx8fbSTdtWuxEkhrfB5KBpWH1_kwVt1_QLef_KYNRPsatfoncPnE0eIs9uvzM1fDXbsy8fi4DwZ860Nn6PEDUpOt0sgJwAnHILWNMgoEQi36nYK3VIHN2gMj-1WWguQ8nwy7U_RfaPJvUPzA Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Domain-Id: None Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Domain-Name: None Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Identity-Status: Confirmed Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Is-Admin-Project: True Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Openstack-Nova-Api-Version: 2.92 Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Domain-Id: default Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Domain-Name: Default Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Project-Name: admin Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Role: admin,reader,member Sep 19 11:18:33.764278 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Roles: admin,reader,member Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/a875b13c6f2b4a43a97ce59e85aa99fd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant: admin Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant-Id: a875b13c6f2b4a43a97ce59e85aa99fd Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-Tenant-Name: admin Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User: admin Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Domain-Id: default Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Domain-Name: Default Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Id: b83cd9cf7ce84815942f0d89b245aefe Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: X-User-Name: admin Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: method: > Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: exception: Flavor 451 could not be found. Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: action_args: {'id': '451'} Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:18:33.765849 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:33.766822 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: ERROR nova.api.openstack.wsgi Sep 19 11:18:33.768185 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-3f40de9e-de6e-47ae-a9ce-7a65b8eeed2e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106036) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:18:33.769436 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-3f40de9e-de6e-47ae-a9ce-7a65b8eeed2e admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.013202 Sep 19 11:18:33.769436 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 27/52] 10.222.0.78 () {60 vars in 1193 bytes} [Mon Sep 19 11:18:33 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 19 11:18:34.984255 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:34.985282 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 19 11:18:34.985676 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 26/53] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:35.507676 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-7253dad3-d323-4755-99f2-6ff157521c4d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:35.573744 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-7253dad3-d323-4755-99f2-6ff157521c4d admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.448767 Sep 19 11:18:35.574227 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 28/54] 10.222.0.78 () {64 vars in 1235 bytes} [Mon Sep 19 11:18:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:36.816154 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:36.817171 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 19 11:18:36.817569 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 27/55] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:37.359492 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-2da17652-79c8-4246-a7e0-30af8f0ceb0f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:37.437766 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-2da17652-79c8-4246-a7e0-30af8f0ceb0f admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.466683 Sep 19 11:18:37.438318 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 29/56] 10.222.0.78 () {64 vars in 1235 bytes} [Mon Sep 19 11:18:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:38.677740 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:38.678739 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 19 11:18:38.679130 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 28/57] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:39.207098 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-3242ae6c-1309-4102-ac11-25ce98328dff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:39.335915 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-3242ae6c-1309-4102-ac11-25ce98328dff admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.517864 Sep 19 11:18:39.336477 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 30/58] 10.222.0.78 () {64 vars in 1235 bytes} [Mon Sep 19 11:18:38 2022] POST /compute/v2.1/flavors => generated 407 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:40.569122 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:40.570228 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001535 Sep 19 11:18:40.570627 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 29/59] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:41.130617 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-8c56eceb-7cb6-4dc9-ad9f-05cd0f403ba1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:18:41.218392 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-8c56eceb-7cb6-4dc9-ad9f-05cd0f403ba1 admin admin] 10.222.0.78 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.508991 Sep 19 11:18:41.218901 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 31/60] 10.222.0.78 () {64 vars in 1235 bytes} [Mon Sep 19 11:18:40 2022] POST /compute/v2.1/flavors => generated 409 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:18:42.465000 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:42.466039 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 19 11:18:42.466438 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 30/61] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:18:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:18:43.009110 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-bde992ab-5d34-4b0a-8af6-3b94653ac297 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:18:43.029929 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-bde992ab-5d34-4b0a-8af6-3b94653ac297 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.425222 Sep 19 11:18:43.030398 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 32/62] 10.222.0.78 () {60 vars in 1202 bytes} [Mon Sep 19 11:18:42 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:19:40.598827 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:19:40.599888 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-d370c9ea-6b9e-4f7a-997d-e9be4c373991 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 19 11:19:40.600295 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 31/63] 10.222.0.78 () {54 vars in 931 bytes} [Mon Sep 19 11:19:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:19:40.610922 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:40.990742 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-dc11fedb-4d0e-4c26-b6c0-6f7c23bb06d7 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:19:41.011491 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-dc11fedb-4d0e-4c26-b6c0-6f7c23bb06d7 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.404969 Sep 19 11:19:41.012666 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 33/64] 10.222.0.78 () {60 vars in 1292 bytes} [Mon Sep 19 11:19:40 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:19:41.033382 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG dbcounter [-] [106037] Writing DB stats nova_api:SELECT=14 {{(pid=106037) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:19:41.037205 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-87b1edfd-7018-4e04-b335-09ac04e1762a admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:19:41.044413 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-87b1edfd-7018-4e04-b335-09ac04e1762a admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012438 Sep 19 11:19:41.044945 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 32/65] 10.222.0.78 () {60 vars in 1283 bytes} [Mon Sep 19 11:19:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:19:41.056754 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-7895f04b-b7c8-4b95-9b5a-04f05f253b4b admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:19:41.064747 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-7895f04b-b7c8-4b95-9b5a-04f05f253b4b admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011627 Sep 19 11:19:41.067398 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 34/66] 10.222.0.78 () {60 vars in 1286 bytes} [Mon Sep 19 11:19:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:19:41.077329 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:19:41.084709 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011559 Sep 19 11:19:41.085242 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 33/67] 10.222.0.78 () {60 vars in 1286 bytes} [Mon Sep 19 11:19:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:19:41.096825 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-66a0e413-2ce9-494c-bf9c-193d4859a419 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:19:41.104440 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-66a0e413-2ce9-494c-bf9c-193d4859a419 admin admin] 10.222.0.78 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011193 Sep 19 11:19:41.104963 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 35/68] 10.222.0.78 () {60 vars in 1283 bytes} [Mon Sep 19 11:19:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:22:54.994281 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:22:54.995355 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Sep 19 11:22:54.995750 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 34/69] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:22:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:22:55.136074 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_api:SELECT=6 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:22:55.292997 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:22:55.297684 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:55.298198 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:55.298631 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:55.299385 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:55.299840 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:55.300263 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:55.332834 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-f5a70cf3-03a7-4c3f-8cd3-73742c837bb3 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.197211 Sep 19 11:22:55.333310 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 36/70] 10.222.0.78 () {60 vars in 1193 bytes} [Mon Sep 19 11:22:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:22:56.427789 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:22:56.428801 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Sep 19 11:22:56.429195 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 35/71] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:22:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:22:56.628194 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:22:56.632286 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:56.632824 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:56.633207 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:56.633922 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:22:56.634410 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:22:56.634921 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:22:56.654501 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-18ecd1c3-cb8e-4cf1-ae74-7d4cfc149db4 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.081120 Sep 19 11:22:56.655067 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 37/72] 10.222.0.78 () {60 vars in 1193 bytes} [Mon Sep 19 11:22:56 2022] GET /compute/v2.1/os-services => generated 791 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:23:08.174708 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:08.175766 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 19 11:23:08.176154 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 36/73] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:23:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:23:08.320372 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_cell0:SELECT=4 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:08.321096 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_cell1:SELECT=4 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:08.321718 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG dbcounter [-] [106036] Writing DB stats nova_api:SELECT=8 {{(pid=106036) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:23:08.369780 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:08.373242 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:08.373721 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:08.374155 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:08.374893 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:08.375402 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:08.375826 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:08.402461 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-185ce557-f531-4dde-858d-2389ac9dbe36 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.086453 Sep 19 11:23:08.403045 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 38/74] 10.222.0.78 () {60 vars in 1193 bytes} [Mon Sep 19 11:23:08 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:23:09.501512 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: DEBUG nova.api.openstack.wsgi [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] Calling method '>' {{(pid=106037) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:09.502529 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: INFO nova.api.openstack.requestlog [None req-f981d71d-480a-4633-b3c2-655c7a1772a3 admin admin] 10.222.0.78 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 19 11:23:09.502970 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: [pid: 106037|app: 0|req: 37/75] 10.222.0.78 () {56 vars in 1074 bytes} [Mon Sep 19 11:23:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:23:09.711541 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG nova.api.openstack.wsgi [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] Calling method '>' {{(pid=106036) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:23:09.715045 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:09.715554 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:09.715988 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:09.716717 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:23:09.717159 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:23:09.717579 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: DEBUG oslo_concurrency.lockutils [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106036) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:23:09.739135 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: INFO nova.api.openstack.requestlog [None req-1d7fd83b-fe56-4257-bdea-50ca64f68eb6 admin admin] 10.222.0.78 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.080145 Sep 19 11:23:09.739717 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: [pid: 106036|app: 0|req: 39/76] 10.222.0.78 () {60 vars in 1193 bytes} [Mon Sep 19 11:23:09 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:24:08.067206 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: Mon Sep 19 11:24:08 2022 - graceful shutdown triggered... Sep 19 11:24:08.066652 dv-cinder-822822-7-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 19 11:24:08.068218 dv-cinder-822822-7-iscsi devstack@n-api.service[106036]: Gracefully killing worker 1 (pid: 106036)... Sep 19 11:24:08.068573 dv-cinder-822822-7-iscsi devstack@n-api.service[106037]: Gracefully killing worker 2 (pid: 106037)... Sep 19 11:24:09.067691 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: worker 1 buried after 1 seconds Sep 19 11:24:09.068251 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: worker 2 buried after 1 seconds Sep 19 11:24:09.068251 dv-cinder-822822-7-iscsi devstack@n-api.service[106035]: goodbye to uWSGI. Sep 19 11:24:09.069243 dv-cinder-822822-7-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 19 11:24:09.069796 dv-cinder-822822-7-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 19 11:24:09.072623 dv-cinder-822822-7-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 19 11:24:09.081946 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 19 11:24:09 2022] *** Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: nodename: dv-cinder-822822-7-iscsi Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: machine: x86_64 Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: clock source: unix Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: pcre jit disabled Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: detected number of CPU cores: 4 Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: current working directory: / Sep 19 11:24:09.083902 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: detected binary path: /usr/bin/uwsgi-core Sep 19 11:24:09.084566 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: your processes number limit is 47680 Sep 19 11:24:09.084566 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: your memory page size is 4096 bytes Sep 19 11:24:09.084566 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: detected max file descriptor number: 2048 Sep 19 11:24:09.084566 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: lock engine: pthread robust mutexes Sep 19 11:24:09.084566 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: thunder lock: enabled Sep 19 11:24:09.084566 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 19 11:24:09.084566 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 19 11:24:09.124533 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: Python main interpreter initialized at 0x55e6a6c099c0 Sep 19 11:24:09.124533 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: python threads support enabled Sep 19 11:24:09.124533 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: your server socket listen backlog is limited to 100 connections Sep 19 11:24:09.124533 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: your mercy for graceful operations on workers is 90 seconds Sep 19 11:24:09.124906 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: mapped 403077 bytes (393 KB) for 2 cores Sep 19 11:24:09.124995 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: *** Operational MODE: preforking *** Sep 19 11:24:09.125276 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: *** uWSGI is running in multiple interpreter mode *** Sep 19 11:24:09.125276 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: spawned uWSGI master process (pid: 121064) Sep 19 11:24:09.128081 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: spawned uWSGI worker 1 (pid: 121084, cores: 1) Sep 19 11:24:09.128081 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: spawned uWSGI worker 2 (pid: 121085, cores: 1) Sep 19 11:24:09.128081 dv-cinder-822822-7-iscsi devstack@n-api.service[121064]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 19 11:24:09.125477 dv-cinder-822822-7-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 19 11:24:09.810643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:24:09.866566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 19 11:24:11.006033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:24:11.006033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: from cryptography.utils import int_from_bytes Sep 19 11:24:11.006903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:24:11.006903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: from cryptography.utils import int_from_bytes Sep 19 11:24:11.035714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:24:11.035714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: from cryptography.utils import int_from_bytes Sep 19 11:24:11.036536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 19 11:24:11.036536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: from cryptography.utils import int_from_bytes Sep 19 11:24:13.455683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:24:13.456344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:24:13.456426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:24:13.456753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:24:13.457010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:24:13.457397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.457732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.457732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.457732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.457732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.457732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.459713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.459713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.460029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.460206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.460494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.460976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-7-iscsi {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.461355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.461613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.461987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.462249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.462607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.462878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.463203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.463719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.465131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.465131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.465131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.465391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.465684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.465982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.466844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.466966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 19 11:24:13.467508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.467594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 19 11:24:13.467677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.467757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 19 11:24:13.467836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.468100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 19 11:24:13.468228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-7-iscsi {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.468319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 19 11:24:13.468519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.468719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.469091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.469329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.469564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.469796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.470010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.470236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.470458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.470681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.470921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.471210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.471439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.471660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.471880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.472104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.472337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.472559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.472811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.473028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.473220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.473413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.473610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.473610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.473955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-822822-7-iscsi {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.474108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.474263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.474428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.474645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.474809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.474957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.475130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.475346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.475511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.475667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.475820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.476010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.476198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.476364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.476529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.476529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.476850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.477027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.477181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.477343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.477502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.477655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.477814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.477972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.478678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.478855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.479006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.479162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.479431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.479586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.479749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.479912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.480061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.480206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.480361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.480509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.480665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.480831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.480831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.481133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-822822-7-iscsi {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.481281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.481454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.481613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.482330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.482489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.482645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.482802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.482965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.483121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.483318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.483476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.483632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.483791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.483939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.484109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.484258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.484413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.484572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.484734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.484888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.485035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.485192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.485350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.485508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.485671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.485821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.485989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.486144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.486876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.487049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.487273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.487444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.487601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.487756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.487904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.488131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.488578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.488925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.489090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.489252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.489406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.489615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.489768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.489924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.490071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.490224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.490371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.490528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.490685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.490843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.491002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.491159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.491362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.491511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.491666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.491814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.491970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.492129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.492286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.492440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.492594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.492749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.492896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.493054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.493215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.493374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.493533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.493689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.493842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.493997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.494146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.494292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.494445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.494602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.494756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.494912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.495077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.495254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.495420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.495569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.495722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.495882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.496030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.496030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.496365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.78 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.496531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.496686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.78 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.496841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.496995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.497153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.497355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.497508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.497662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.497809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.497963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.498118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.498279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.498688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.498872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.499286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.499451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.499675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.499830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.499977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.500133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.500280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.500434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.500590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.500737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.500902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.501064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.501219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.501366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.501523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.501687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.501835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.501988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.502142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.502296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.502456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.502614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.502760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.502916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.503078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.503266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.503426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.503586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.503755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.503909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.504063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.504227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.504382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.504539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.504693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.504848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.504996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.505154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.505309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.505456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.505456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.505761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.505915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.506074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.506230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.506377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.506523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.506678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.506842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.506996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.507150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.507365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.507514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.507671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.508011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.508177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.508335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.508529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.508905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.509089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.509434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.509593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.509785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.509952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.510102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.510248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.510415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.510562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.510709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.510881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.511038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.511205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.511406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.511563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.511720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.511867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.512022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.512180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.512334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.512492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.512647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.512802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.512976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.513136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.513284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.513438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.513603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.513603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.513887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.514040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.514197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.514344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.514510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.514658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.514815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.514962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.515108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.515302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.515451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.515604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.515752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.515905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.516059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.516223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.516380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.516534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.516689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.516844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.517078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.517237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.517399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.517554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.517709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.517896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 19 11:24:13.518048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.518202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.518360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.518517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.518671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.519090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.519305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.519666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.519875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.520028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.520185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.520379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.520546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.520694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.520860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.521037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.521195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.521350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.521499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.521653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.521808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.521961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.522108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.522261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.522409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.522564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.522712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.522857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.523022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.523205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.523359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.523525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.523672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.523825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.523972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.524118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.524275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.524431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.524587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.524740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.524887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.525051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.525218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.525376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.525523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.525677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.525832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.525979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.526133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.526288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.526447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.526602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.526757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.526903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.527072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.527236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.527389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.527554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.527711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.527857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.528013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.528166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.528313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.528458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.529488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.529883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.530070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.530070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.530362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.530516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.530663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.530835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.530985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.531138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.531351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.531500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.531657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.531819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.531976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.532134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.532337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.532485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.532640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.532796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.532955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.533112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.533259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.533406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.533566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.533713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.533868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.534024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.534192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.534347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.534508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.534663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.534811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.534956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.535104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.539026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.539266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.539480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.539642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.539827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.540039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.540219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.540385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.540534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.540690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.540858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.541009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.541171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.541320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.541467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.541615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.541769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.541929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.542087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.542246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.542402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.542551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.542698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.542853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.543017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.543200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.543358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.543523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.547015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.547247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.547439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.547614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.547856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.548020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.548179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.548344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.548494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.548642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.548789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.548961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.549110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.549274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.549430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.549586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.549747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.549747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.550082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.550246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.550403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.550551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.550698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.550857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.551013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.551189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.551345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.551493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.551641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.551800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.551965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.552121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.552269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.552416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.552565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.552720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.552878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.553026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.553181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.553328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.553482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.553646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.553910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.554088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.554236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.554390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.554537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.555349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.555532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.555684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.555830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.555988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.556135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.556289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.556459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.556608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.556764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.557637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.557799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.557997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.558149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.558305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.558454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.558650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.558811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.558975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.559387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.559569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.560223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.560382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.560531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.560693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.560893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.561051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.561208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.561358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.561504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.562396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.563144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.563349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.564430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.564607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.564767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.564978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.565413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.565568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.565717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.565879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.566028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.566183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.566339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.566489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.566656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.566814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.566961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.567160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.567334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.567494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.567652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.567815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.567971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.568126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.568273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.568702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.568884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.569034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.569224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.569376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.569523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.569671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.569831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.569979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.570368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.570523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.570649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.570780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.570910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.571036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.571158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.579141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.579377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.579553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.579726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.579880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.580031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.580182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.580330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.580537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.580537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.581191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.581365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.581513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.583290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.583492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.583669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.583840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.583999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.584146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.584303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.584461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.584636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.584793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.584942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.585143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.585297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.585455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.585614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.585762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.585908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.586064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.586219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.586377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.586525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.586680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.586835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.587353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.587539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.587700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.587856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.589362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.589539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.589701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.589868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.590025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.590181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.590337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.590493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.590705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.590874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.593638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.594082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.594255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.594419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.594580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.594740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.594899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.595056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.595227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.595425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.595590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.595747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.595908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.596063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.596211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.597395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.597573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.597770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.597933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.598082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.598236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.598384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.598541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.598697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.598858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.599027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.599240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.599404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.599569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.599723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.599876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.600053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.600210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.600210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.600519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.600718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.600884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.601040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.601258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.601425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.601588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.601735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.601884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.602045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.602207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.602355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.602521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.602728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.602898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.603054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.603249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.603470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.603638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.603794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.603963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.604125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.604288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.604454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.604615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.604785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.604951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.605106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.605274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.605439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.605601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.605803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.606063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.606220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.606384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.607772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.607953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.608127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.608283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.608485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.608652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.608815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.608990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.609156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.609319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.609519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.609679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.609841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.610003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.610172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.610336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.610494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.610657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.610859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.611016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.611016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.611525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.611686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.611856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.612011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.612182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.612344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.612500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.612655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.612809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.612809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.613119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.613323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.613441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.613589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.613735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.613735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.614516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.614641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.614756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.614869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.614869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.615106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.615244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.615363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.618938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.619119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.619364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.619534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.619737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.619895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.620051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.620215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.620398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.620613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.620772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.620989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.621231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.621552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.621723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.621948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.622116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.622306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.622483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.622640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.622809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.622973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.623137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.623392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.623569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.623733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.623899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.624062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.624225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.624387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.624555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.624718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.624873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.625034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.625191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.625359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.625522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.625714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.625890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.626100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.626265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.626438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.626602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.626860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.627254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.627419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.627818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.628102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.628265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.628429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.628697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.628878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.629042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.629211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.629376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.629531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.629687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.629841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.630076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.630267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.630431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.630586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.630748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.630911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.631133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.631318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.631476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.631722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.631888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.632053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.632219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.632376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.632538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.632693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.632848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.633001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.633171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.633345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.633508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.633665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.633819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.633988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.634186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.634353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.634509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.634664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.634817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.634979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.635134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.635377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.635535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.635726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.635886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.636054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.636209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.636364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.636519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.636672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.636955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.639422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.639613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.639613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.639942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.640109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.640276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.640276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.640590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.640746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.640902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.641057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.641269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.641431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.641586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.641835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.641998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.642223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.642399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.642571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.642727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.642881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.643046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.643266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.643449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.643605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.643769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.643931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.644096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.644251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.644427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.644589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.644745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.644898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.645060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.645226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.645381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.645541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.645697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.645850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.646048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.646225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.646381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.646553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.646714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.646876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.647052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.647576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.647743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.647934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.648257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.648429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.648618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.648793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.648951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.649115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.649270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.649641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.649817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.649983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.650138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.650345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.650506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.650668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.650832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.650997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.650997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.651362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.651554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.651723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.651983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.652144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.652306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.652463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.653220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.653220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.654069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.654241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.654408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.654577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.654741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.655134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.655323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.655479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.655651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.655808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.656950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.657150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.657268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.657268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.657811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.657936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.658050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.658191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.658553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.658668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.658791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.658911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.659025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.659357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.659357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.659925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.660098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.660254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.660408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.660572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.660734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.660900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.661054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.661207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.661439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.661601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.661755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.661755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.662204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.662367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.662532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.662695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.662850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.663012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.663248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.663413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.663591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.663748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.663902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.664065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.664221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.664418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.664590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.664746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.664907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.665071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.665071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.665413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.665584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.665750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.665904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.666065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.666705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.666812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.666901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.666986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.667078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.667189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.667328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.667894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.668040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.668177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.668319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.668665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.668814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.668814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.669207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.669207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.670259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.670402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.670580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.670580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.670832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.670963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.671093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.671262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.671406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.671559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.671689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.671826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.672003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.672161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.672161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.672509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.672639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.672778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.672909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.673038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.673181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.673320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.673463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.673602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.673742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.673883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.674065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.674211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.674352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.674487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.674634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.674768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.674908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.675042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.675244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.675397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.675542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.675542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.675802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.675944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.676077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.676219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.676353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.676353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.676614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.676754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.676896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.677038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.677172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.677304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.677436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.677568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.677783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.677936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.678114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.678249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.678386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.678519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.678818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.678963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.679105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.679263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.679410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.679545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.679692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.679827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.679959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.680337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.680486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.680630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.680839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.680983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.681118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.681259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.681392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.681525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.681666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.681666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.681928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.682061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.682220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.682378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.682587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.682723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.682857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.682857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.683974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.684236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.684376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.684517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.684665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.684812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.684957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.685092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.685233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.685365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.685497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.685642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.685775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.685915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.686055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.686187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.686357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.686499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.686632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.686764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.686904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.687264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.688188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.688303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.688431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.688552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.688672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.688962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.689889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.690003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.690123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.690440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.694133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.694292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.694414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.694663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.694791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.694914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.695989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.696165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.696296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.696424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.696554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.696668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.696789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.696903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.697960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.698193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.698331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.698499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.698643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.698763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.699080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.699272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.699410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.699551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.699551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.699551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.699936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.700072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.700204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.700335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.700335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.700335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.700335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.701065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.701205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.701338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.701470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.701604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.701753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.701753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.702015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.702156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.702290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.702437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.702580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.702580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.702930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.703066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.703257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.703405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.703529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.703644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.703770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.703893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.704928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.705063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.705196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.705337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.705337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.705598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.705598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.706078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.706238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.706374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.706543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.706690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.706825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.706969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.707102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.707277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.707277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.707549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.707682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.707815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.707948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.708081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.708302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.708446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.708578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.708709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.708840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.708970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.709267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.709406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.709539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.709672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.709805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.709951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.710094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.710229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.710376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.710510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.710752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.711067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.711314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.711456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.711590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.711723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.711853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.711998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.712141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.712285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.712430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.712564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.712706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.712841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.713053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.713189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.713329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.713329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.713592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.713733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.713877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.714019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.714165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.714314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.714449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.714628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.714773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.714773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.715026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.715026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.715026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.715026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.715604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.715739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.715872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.716565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.716565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.716824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.716956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.717088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.717230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.717373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.717509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.717649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.717782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.717915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.718061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.718204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.718414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.718552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.718684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.719061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.719374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.719522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.719658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.719802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.719944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.719944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.720208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.720351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.720484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.720618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.720765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.720997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.721222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.721367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.721510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.721649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.721782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.721924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.722908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.723265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.723403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.723536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.723693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.723837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.723971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.724111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.724244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.724391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.724525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.724658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.724790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.724923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.725063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.725063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.725334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.725334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.725602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.725744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.725888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.726047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.726191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.726325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.726464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.726598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.726730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.726876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.727019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.727153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.727330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.727473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.727607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.727749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.727889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.728024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.728159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.728346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.728551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.728690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.728820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.728935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.729049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.729178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.729302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.729524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.729652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.729774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.729895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.730889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.731122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.731365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.731503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.731698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.731849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.732481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.732621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.732755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.732897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.733039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.733190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.733413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.733558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.733706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.733848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.733848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.734128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.734288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.734425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.734566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.734736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.734860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.734991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.735107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.739624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.739739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.739829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.739975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.740960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.741064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.741178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.741275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.741547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.741650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.741747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.741903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.742961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.743908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.744004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.744004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.744538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.744641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.744732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.744818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.744914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.745799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.746841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.747957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.748943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.749930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.750988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.751144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.751299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.751390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.751508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.751738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.751844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.751947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.752940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.753923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.754937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.755932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.756792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.757949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.758926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.759982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.760866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.761965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.762970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.763971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.764995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:24:13.765353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 19 11:24:13.765353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 19 11:24:13.790365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO dbcounter [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Registered counter for database nova_api Sep 19 11:24:13.792350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO dbcounter [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Registered counter for database nova_api Sep 19 11:24:13.812056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_db.sqlalchemy.engines [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:13.813232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:13.818832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writer thread running {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:13.820357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writer thread running {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:13.876159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.context [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f81a8dc-976d-4306-9181-384261ba6896(cell1) {{(pid=121085) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:24:13.879237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.context [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8f81a8dc-976d-4306-9181-384261ba6896(cell1) {{(pid=121084) load_cells /opt/stack/nova/nova/context.py:464}} Sep 19 11:24:13.880241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.880719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.882294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.883067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.883515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.883688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.884113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.885553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.885824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.886696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:24:13.887151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:24:13.888558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO dbcounter [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Registered counter for database nova_cell0 Sep 19 11:24:13.889747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:24:13.891822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO dbcounter [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Registered counter for database nova_cell0 Sep 19 11:24:13.892403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO dbcounter [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Registered counter for database nova_cell1 Sep 19 11:24:13.896860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO dbcounter [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Registered counter for database nova_cell1 Sep 19 11:24:13.900253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_db.sqlalchemy.engines [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:13.902024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_db.sqlalchemy.engines [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:13.906921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:13.908077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:13.908919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writer thread running {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:13.914123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writer thread running {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:13.915199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writer thread running {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:13.916407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writer thread running {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:14.058270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO dbcounter [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Registered counter for database nova_cell0 Sep 19 11:24:14.065650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_db.sqlalchemy.engines [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:14.066718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO dbcounter [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Registered counter for database nova_cell0 Sep 19 11:24:14.070663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writer thread running {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:14.076166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_db.sqlalchemy.engines [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 19 11:24:14.080662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writer thread running {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 19 11:24:14.404284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: WARNING keystonemiddleware.auth_token [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:24:14.411965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: WARNING keystonemiddleware.auth_token [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:24:14.412849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: WARNING keystonemiddleware.auth_token [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:24:14.420843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: WARNING keystonemiddleware.auth_token [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:24:14.788047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: WARNING keystonemiddleware.auth_token [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:24:14.794877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: WARNING keystonemiddleware.auth_token [None req-c6ece76d-bf24-4354-86e4-4413f33d8d24 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:24:14.798060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: WARNING keystonemiddleware.auth_token [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 19 11:24:14.800937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6a6c099c0 pid: 121084 (default app) Sep 19 11:24:14.806001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: WARNING keystonemiddleware.auth_token [None req-1bcc8b1c-647d-48e4-ae8c-135529710007 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 19 11:24:14.811544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6a6c099c0 pid: 121085 (default app) Sep 19 11:24:53.069673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:53.069673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:53.070520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:53.071045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:53.475051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:53.482635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:53.483870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:53.487371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:24:54.586887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2e308b01-0c32-4b9f-97d3-b33a2eb04d51 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Action: 'create', calling method: .version_select at 0x7f4b9b4f7430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-388345410", "metadata": {"Type": "work"}}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:54.830254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e29621e8-9767-4dcd-a28b-9016e28627ff tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Action: 'create', calling method: .version_select at 0x7f4b9b4f64c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-577436489", "metadata": {"Type": "work"}}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e29621e8-9767-4dcd-a28b-9016e28627ff tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Request method failure captured: Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 121 Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGFNPYRqyEN5OhbJSLAgOLw5wUdtKPIy3Irkb1V7gt_4lrPWr7wUm07cw7UmFGqH02400fUHT-HQ-xlggO0s6YXxYarMbQaIEYfFJljmz6lRloIseacPfA4cOyDvFMtRCQMPlqNQta1q-96TpZm3yq-r83QPIFjCLcbdA1k1rThovo Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:24:54.837148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 42eb827ed7f440ecb60581821f686d39 Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-577436489", "metadata": {"Type": "work"}}} Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: Sep 19 11:24:54.838616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-577436489', 'metadata': {'Type': 'work'}}}} Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi '#$%' Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:54.839464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:24:54.841336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:24:54.842771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 19 11:24:54.842771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:54.844328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e29621e8-9767-4dcd-a28b-9016e28627ff tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:54.845571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e29621e8-9767-4dcd-a28b-9016e28627ff tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.393599 Sep 19 11:24:54.846719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1/1] 10.222.0.78 () {60 vars in 1156 bytes} [Mon Sep 19 11:24:53 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1398 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:24:55.265152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-689cf867-47b7-4b03-9c1c-471015e0f43e tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Action: 'create', calling method: .version_select at 0x7f4b9b4f6dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1690600487"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:57.104425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2e308b01-0c32-4b9f-97d3-b33a2eb04d51 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.051530 Sep 19 11:24:57.105719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1/2] 10.222.0.78 () {60 vars in 1156 bytes} [Mon Sep 19 11:24:53 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4055 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 11:24:57.111631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-64982e54-ebcf-4f2e-afd5-e6140cbf3b95 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Action: 'create', calling method: .version_select at 0x7f4b9b3c8280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-818498691", "metadata": {"Type": "work"}}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-64982e54-ebcf-4f2e-afd5-e6140cbf3b95 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Request method failure captured: Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 119 Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGFNPYRqyEN5OhbJSLAgOLw5wUdtKPIy3Irkb1V7gt_4lrPWr7wUm07cw7UmFGqH02400fUHT-HQ-xlggO0s6YXxYarMbQaIEYfFJljmz6lRloIseacPfA4cOyDvFMtRCQMPlqNQta1q-96TpZm3yq-r83QPIFjCLcbdA1k1rThovo Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:24:57.134803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 42eb827ed7f440ecb60581821f686d39 Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-818498691", "metadata": {"Type": "work"}}} Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: Sep 19 11:24:57.136135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-818498691', 'metadata': {'Type': 'work'}}}} Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi '0' Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:57.138169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:24:57.139297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:24:57.140178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 19 11:24:57.140178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.140178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-64982e54-ebcf-4f2e-afd5-e6140cbf3b95 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:57.140178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-64982e54-ebcf-4f2e-afd5-e6140cbf3b95 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032712 Sep 19 11:24:57.141611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 2/3] 10.222.0.78 () {60 vars in 1156 bytes} [Mon Sep 19 11:24:57 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 35 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:24:57.157150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1f947197-7bd5-4192-9000-790ca898214a tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9b35cdc0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:57.219753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-689cf867-47b7-4b03-9c1c-471015e0f43e tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.369798 Sep 19 11:24:57.221860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 2/4] 10.222.0.78 () {60 vars in 1155 bytes} [Mon Sep 19 11:24:54 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 2374 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 19 11:24:57.232216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d4be0548-02c5-4153-a188-9cd19fecdb9c tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Calling method '.version_select at 0x7f4b9b386940>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:57.340586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1f947197-7bd5-4192-9000-790ca898214a tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/e749e770-ac3e-487d-a7a0-1e42d30e08c2" status: 200 len: 351 microversion: 2.1 time: 0.196457 Sep 19 11:24:57.347449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 3/5] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:57 2022] GET /compute/v2.1/os-volumes/e749e770-ac3e-487d-a7a0-1e42d30e08c2 => generated 351 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:57.347449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54628033-c6c5-48f6-81b7-d9220fa9cb3a tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Action: 'create', calling method: .version_select at 0x7f4b9b35c040>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1474053014", "metadata": {"Type": "work"}}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54628033-c6c5-48f6-81b7-d9220fa9cb3a tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Request method failure captured: Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 119 Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGFNPYRqyEN5OhbJSLAgOLw5wUdtKPIy3Irkb1V7gt_4lrPWr7wUm07cw7UmFGqH02400fUHT-HQ-xlggO0s6YXxYarMbQaIEYfFJljmz6lRloIseacPfA4cOyDvFMtRCQMPlqNQta1q-96TpZm3yq-r83QPIFjCLcbdA1k1rThovo Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:24:57.353653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 42eb827ed7f440ecb60581821f686d39 Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1474053014", "metadata": {"Type": "work"}}} Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: Sep 19 11:24:57.354894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1474053014', 'metadata': {'Type': 'work'}}}} Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise error Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi '' Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:57.356213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 19 11:24:57.357511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 19 11:24:57.358414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 19 11:24:57.358414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:57.358414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54628033-c6c5-48f6-81b7-d9220fa9cb3a tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:57.360096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-54628033-c6c5-48f6-81b7-d9220fa9cb3a tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.016902 Sep 19 11:24:57.362013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 4/6] 10.222.0.78 () {60 vars in 1156 bytes} [Mon Sep 19 11:24:57 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 19 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:24:57.369767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45201e38-3b18-4d65-82df-810c35246547 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b3c8160>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:57.437876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d4be0548-02c5-4153-a188-9cd19fecdb9c tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c" status: 200 len: 352 microversion: 2.1 time: 0.213839 Sep 19 11:24:57.438666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 3/7] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:57 2022] GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c => generated 352 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:57.447787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99b55144-1052-4e40-9e60-1237c0a480a9 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Calling method '.version_select at 0x7f4b9b395040>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:57.516591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45201e38-3b18-4d65-82df-810c35246547 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4" status: 200 len: 345 microversion: 2.1 time: 0.153487 Sep 19 11:24:57.524461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 5/8] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:57 2022] GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 => generated 345 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:58.343825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-99b55144-1052-4e40-9e60-1237c0a480a9 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] HTTP exception thrown: Volume tempest-invalid-962504451 could not be found. Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99b55144-1052-4e40-9e60-1237c0a480a9 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Request method failure captured: Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-962504451 HTTP/1.1 Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGFNPYRqyEN5OhbJSLAgOLw5wUdtKPIy3Irkb1V7gt_4lrPWr7wUm07cw7UmFGqH02400fUHT-HQ-xlggO0s6YXxYarMbQaIEYfFJljmz6lRloIseacPfA4cOyDvFMtRCQMPlqNQta1q-96TpZm3yq-r83QPIFjCLcbdA1k1rThovo Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:24:58.359799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 42eb827ed7f440ecb60581821f686d39 Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Volume tempest-invalid-962504451 could not be found. Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': 'tempest-invalid-962504451'} Sep 19 11:24:58.361352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-962504451 could not be found. (HTTP 404) (Request-ID: req-41c6ad3b-5bc9-47cb-b68c-85e671ddbe62) Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:58.361974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:24:58.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-962504451 could not be found. Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:24:58.363882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-962504451 could not be found. Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-962504451 could not be found. Sep 19 11:24:58.364925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.374419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99b55144-1052-4e40-9e60-1237c0a480a9 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Returning 404 to user: Volume tempest-invalid-962504451 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:58.376294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-99b55144-1052-4e40-9e60-1237c0a480a9 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/tempest-invalid-962504451" status: 404 len: 98 microversion: 2.1 time: 0.936493 Sep 19 11:24:58.382623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 4/9] 10.222.0.78 () {58 vars in 1215 bytes} [Mon Sep 19 11:24:57 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-962504451 => generated 98 bytes in 943 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:24:58.392197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-746e0e66-a46c-4eff-b28a-dc43956b5dac tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005388 Sep 19 11:24:58.393550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 6/10] 10.222.0.78 () {58 vars in 1140 bytes} [Mon Sep 19 11:24:58 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 7 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 11:24:58.417312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-77f84351-3a35-4cab-97a2-1372a6a0ecc6 tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017949 Sep 19 11:24:58.430083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdad750b-da1a-40bb-87cf-ad8dacd450bd tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Calling method '.version_select at 0x7f4b9b3c84c0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.435159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 5/11] 10.222.0.78 () {58 vars in 1137 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 36 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 19 11:24:58.460685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-daecaaf8-58ca-47f1-8a03-1beadb708078 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Calling method '.version_select at 0x7f4b9b2ec310>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.887599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-cdad750b-da1a-40bb-87cf-ad8dacd450bd tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] HTTP exception thrown: Volume 94d47ba3-1307-4b52-abb5-a8d0de086c81 could not be found. Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdad750b-da1a-40bb-87cf-ad8dacd450bd tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Request method failure captured: Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/os-volumes/94d47ba3-1307-4b52-abb5-a8d0de086c81 HTTP/1.1 Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGFNPYRqyEN5OhbJSLAgOLw5wUdtKPIy3Irkb1V7gt_4lrPWr7wUm07cw7UmFGqH02400fUHT-HQ-xlggO0s6YXxYarMbQaIEYfFJljmz6lRloIseacPfA4cOyDvFMtRCQMPlqNQta1q-96TpZm3yq-r83QPIFjCLcbdA1k1rThovo Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:24:58.891558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 42eb827ed7f440ecb60581821f686d39 Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Volume 94d47ba3-1307-4b52-abb5-a8d0de086c81 could not be found. Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '94d47ba3-1307-4b52-abb5-a8d0de086c81'} Sep 19 11:24:58.892643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 94d47ba3-1307-4b52-abb5-a8d0de086c81 could not be found. (HTTP 404) (Request-ID: req-9ad12b24-a1be-4812-9de4-85e869cec771) Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:58.893379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:24:58.894241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 94d47ba3-1307-4b52-abb5-a8d0de086c81 could not be found. Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:24:58.899918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 94d47ba3-1307-4b52-abb5-a8d0de086c81 could not be found. Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 94d47ba3-1307-4b52-abb5-a8d0de086c81 could not be found. Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdad750b-da1a-40bb-87cf-ad8dacd450bd tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Returning 404 to user: Volume 94d47ba3-1307-4b52-abb5-a8d0de086c81 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cdad750b-da1a-40bb-87cf-ad8dacd450bd tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/94d47ba3-1307-4b52-abb5-a8d0de086c81" status: 404 len: 109 microversion: 2.1 time: 0.468942 Sep 19 11:24:58.902207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 7/12] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 11:24:58 2022] DELETE /compute/v2.1/os-volumes/94d47ba3-1307-4b52-abb5-a8d0de086c81 => generated 109 bytes in 471 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:24:58.914417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-73c58d65-5dda-49d4-9fd1-c2919c918f0d tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2ea670>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:58.981301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-daecaaf8-58ca-47f1-8a03-1beadb708078 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c" status: 200 len: 353 microversion: 2.1 time: 0.530841 Sep 19 11:24:58.982080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 6/13] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c => generated 353 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:24:59.001083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-67446b4f-9711-4993-9301-6124d24ca1aa tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Calling method '.version_select at 0x7f4b9b395dc0>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:59.099995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-73c58d65-5dda-49d4-9fd1-c2919c918f0d tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4" status: 200 len: 346 microversion: 2.1 time: 0.200942 Sep 19 11:24:59.099995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 8/14] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 => generated 346 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:59.109067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-67446b4f-9711-4993-9301-6124d24ca1aa tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] HTTP exception thrown: Volume d2382cf0-2650-4e89-aa98-09d835a080db could not be found. Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-67446b4f-9711-4993-9301-6124d24ca1aa tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Request method failure captured: Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/os-volumes/d2382cf0-2650-4e89-aa98-09d835a080db HTTP/1.1 Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGFNPYRqyEN5OhbJSLAgOLw5wUdtKPIy3Irkb1V7gt_4lrPWr7wUm07cw7UmFGqH02400fUHT-HQ-xlggO0s6YXxYarMbQaIEYfFJljmz6lRloIseacPfA4cOyDvFMtRCQMPlqNQta1q-96TpZm3yq-r83QPIFjCLcbdA1k1rThovo Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:24:59.111139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/e3a8ceb9271e4036a1bba2e45e1de8ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: e3a8ceb9271e4036a1bba2e45e1de8ac Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesNegativeTest-187364760 Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 42eb827ed7f440ecb60581821f686d39 Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesNegativeTest-187364760-project Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Volume d2382cf0-2650-4e89-aa98-09d835a080db could not be found. Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': 'd2382cf0-2650-4e89-aa98-09d835a080db'} Sep 19 11:24:59.112169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d2382cf0-2650-4e89-aa98-09d835a080db could not be found. (HTTP 404) (Request-ID: req-204dc438-bb7d-4aca-81f4-427bd5fd196a) Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:59.112806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:24:59.114475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d2382cf0-2650-4e89-aa98-09d835a080db could not be found. Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:24:59.115705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d2382cf0-2650-4e89-aa98-09d835a080db could not be found. Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d2382cf0-2650-4e89-aa98-09d835a080db could not be found. Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-67446b4f-9711-4993-9301-6124d24ca1aa tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] Returning 404 to user: Volume d2382cf0-2650-4e89-aa98-09d835a080db could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-67446b4f-9711-4993-9301-6124d24ca1aa tempest-VolumesNegativeTest-187364760 tempest-VolumesNegativeTest-187364760-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/d2382cf0-2650-4e89-aa98-09d835a080db" status: 404 len: 109 microversion: 2.1 time: 0.129175 Sep 19 11:24:59.116948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 7/15] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:58 2022] GET /compute/v2.1/os-volumes/d2382cf0-2650-4e89-aa98-09d835a080db => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:24:59.123713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d97605b-c5c7-463a-988e-913cda91e371 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Calling method '.version_select at 0x7f4b9b3c8b80>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:59.135781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b18b6b2e-4d9a-4605-812c-d1c54bcdf245 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Action: 'create', calling method: .version_select at 0x7f4b9b2ec160>, body: {"snapshot": {"volume_id": "85a9249a-c8da-442e-bf15-89a4d8e9eba4", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-964506412"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:24:59.242286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d97605b-c5c7-463a-988e-913cda91e371 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c" status: 200 len: 353 microversion: 2.1 time: 0.126944 Sep 19 11:24:59.243305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 9/16] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:59 2022] GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:24:59.265948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9998e0b7-c925-44a6-82bd-b88bfbd6e8b4 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Calling method '.version_select at 0x7f4b9b2ea160>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:59.613171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9998e0b7-c925-44a6-82bd-b88bfbd6e8b4 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c" status: 202 len: 0 microversion: 2.1 time: 0.351969 Sep 19 11:24:59.614044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 10/17] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 11:24:59 2022] DELETE /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c => generated 0 bytes in 353 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:24:59.622270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ca6cc7a5-9ed7-4740-a872-9598c89aee97 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Calling method '.version_select at 0x7f4b9b2ea430>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:24:59.786871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ca6cc7a5-9ed7-4740-a872-9598c89aee97 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c" status: 200 len: 352 microversion: 2.1 time: 0.167969 Sep 19 11:24:59.787787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 11/18] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:24:59 2022] GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c => generated 352 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:00.053091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-577b698b-3734-44cb-9c67-c5ccbe0ea7dd tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9b3c8550>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:00.066367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b18b6b2e-4d9a-4605-812c-d1c54bcdf245 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.952178 Sep 19 11:25:00.073407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 8/19] 10.222.0.78 () {60 vars in 1162 bytes} [Mon Sep 19 11:24:59 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:00.087680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7cf83dae-a2d9-40e6-adac-17d124d940ef tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2ecb80>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:00.216950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-577b698b-3734-44cb-9c67-c5ccbe0ea7dd tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/4a706762-f92e-4dfb-849c-34a1c1e76010" status: 200 len: 351 microversion: 2.1 time: 0.169345 Sep 19 11:25:00.218417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 12/20] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:25:00 2022] GET /compute/v2.1/os-volumes/4a706762-f92e-4dfb-849c-34a1c1e76010 => generated 351 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:25:00.356557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7cf83dae-a2d9-40e6-adac-17d124d940ef tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e" status: 200 len: 286 microversion: 2.1 time: 0.281297 Sep 19 11:25:00.365542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 9/21] 10.222.0.78 () {58 vars in 1251 bytes} [Mon Sep 19 11:25:00 2022] GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e => generated 286 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:00.372297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-91979d05-1214-4600-91c9-64a42c0a0db5 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2eaca0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:00.804559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f242c469-7a12-4fc1-bc54-b72ae7341610 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Calling method '.version_select at 0x7f4b9b386d30>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:01.307994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-91979d05-1214-4600-91c9-64a42c0a0db5 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.942482 Sep 19 11:25:01.309430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 13/22] 10.222.0.78 () {58 vars in 1140 bytes} [Mon Sep 19 11:25:00 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:01.320495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-97548693-5a54-4527-af81-9277974aa8b9 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2ee310>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:01.346433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-f242c469-7a12-4fc1-bc54-b72ae7341610 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] HTTP exception thrown: Volume ca7f6baf-d2f2-46ba-9886-34f47ebb970c could not be found. Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f242c469-7a12-4fc1-bc54-b72ae7341610 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Request method failure captured: Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c HTTP/1.1 Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGE27FQTBrdOmf4VIWLBuBUl6gHzmVcqrVo8ZQWOO0_1Epf7S6-aPYehImYnCLdYwkGV9BU5hHZLVPoLRsDAsnkueJ8Be_K-3XN1Tn_izeiGtBtJtGJJdc5l5Iowbe1uDsjvGCzGGuIEwmj8HwyBT5ETy0lnEa5wicVgdraH75hazc Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 68f214f15a7b46f2a05c1d8ff0ea6692 Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesGetTestJSON-2121159872 Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:25:01.348908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68f214f15a7b46f2a05c1d8ff0ea6692"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/68f214f15a7b46f2a05c1d8ff0ea6692"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_68f214f15a7b46f2a05c1d8ff0ea6692"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/68f214f15a7b46f2a05c1d8ff0ea6692"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesGetTestJSON-2121159872 Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 68f214f15a7b46f2a05c1d8ff0ea6692 Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesGetTestJSON-2121159872 Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesGetTestJSON-2121159872-project Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: c36f918242244a37ab06617ca0ec2eab Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesGetTestJSON-2121159872-project Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Volume ca7f6baf-d2f2-46ba-9886-34f47ebb970c could not be found. Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': 'ca7f6baf-d2f2-46ba-9886-34f47ebb970c'} Sep 19 11:25:01.350036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ca7f6baf-d2f2-46ba-9886-34f47ebb970c could not be found. (HTTP 404) (Request-ID: req-f68c6ff4-c052-408e-b857-b2378ced0bac) Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:01.350692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:01.351619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ca7f6baf-d2f2-46ba-9886-34f47ebb970c could not be found. Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:25:01.352504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ca7f6baf-d2f2-46ba-9886-34f47ebb970c could not be found. Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ca7f6baf-d2f2-46ba-9886-34f47ebb970c could not be found. Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f242c469-7a12-4fc1-bc54-b72ae7341610 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] Returning 404 to user: Volume ca7f6baf-d2f2-46ba-9886-34f47ebb970c could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f242c469-7a12-4fc1-bc54-b72ae7341610 tempest-VolumesGetTestJSON-2121159872 tempest-VolumesGetTestJSON-2121159872-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c" status: 404 len: 109 microversion: 2.1 time: 0.552601 Sep 19 11:25:01.353462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 10/23] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:25:00 2022] GET /compute/v2.1/os-volumes/ca7f6baf-d2f2-46ba-9886-34f47ebb970c => generated 109 bytes in 556 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:25:01.550358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-97548693-5a54-4527-af81-9277974aa8b9 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e" status: 200 len: 286 microversion: 2.1 time: 0.233653 Sep 19 11:25:01.551075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 14/24] 10.222.0.78 () {58 vars in 1251 bytes} [Mon Sep 19 11:25:01 2022] GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e => generated 286 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:25:02.053801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1648790535", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:02.268003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] validate_networks() for [('f8725e24-32ff-48e9-8c98-5e2c3e121e45', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:25:02.565277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-37b86b13-9cce-4f23-b027-aa9ec5770058 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2ea280>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:02.628789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-37b86b13-9cce-4f23-b027-aa9ec5770058 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e" status: 200 len: 286 microversion: 2.1 time: 0.069328 Sep 19 11:25:02.630031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 15/25] 10.222.0.78 () {58 vars in 1251 bytes} [Mon Sep 19 11:25:02 2022] GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:25:03.641958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-abb6a326-61bd-4f74-a551-248b2bcba06f tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2eac10>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:03.713775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-abb6a326-61bd-4f74-a551-248b2bcba06f tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e" status: 200 len: 287 microversion: 2.1 time: 0.075444 Sep 19 11:25:03.719244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 16/26] 10.222.0.78 () {58 vars in 1251 bytes} [Mon Sep 19 11:25:03 2022] GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:03.727136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2a7fdfc5-457f-4e90-b949-1e41e61bc6e6 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b3c8790>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:03.966044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2a7fdfc5-457f-4e90-b949-1e41e61bc6e6 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "DELETE /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e" status: 202 len: 0 microversion: 2.1 time: 0.243158 Sep 19 11:25:03.968264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 17/27] 10.222.0.78 () {58 vars in 1254 bytes} [Mon Sep 19 11:25:03 2022] DELETE /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e => generated 0 bytes in 244 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:25:03.979201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-95433cb7-fe0c-4152-a681-7bd60ad5ec85 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b3c8160>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:04.058499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-95433cb7-fe0c-4152-a681-7bd60ad5ec85 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e" status: 200 len: 286 microversion: 2.1 time: 0.082885 Sep 19 11:25:04.063915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 18/28] 10.222.0.78 () {58 vars in 1251 bytes} [Mon Sep 19 11:25:03 2022] GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:04.332653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:25:04.332653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:25:04.332653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:25:04.332653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:25:04.332653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:25:04.334416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:04.334416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:04.334416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:04.334416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:04.335824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:04.335824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:04.374675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:04.385589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for user d6fee905418f4d879da460b6758d4f23 and project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:04.401875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:25:04.406339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:25:04.840706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-82eaf8a6-c7e6-4eee-9614-6ececc363498 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.952722 Sep 19 11:25:04.843280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 11/29] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:25:01 2022] POST /compute/v2.1/servers => generated 383 bytes in 2960 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 11:25:04.853812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3c33e259-783a-4ee5-8c65-e5dccf2d7272 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:04.855819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3c33e259-783a-4ee5-8c65-e5dccf2d7272 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:04.986722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7ae970b1-67d9-421b-9850-31be915d55bf tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9a9e75e0>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:05.075641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7ae970b1-67d9-421b-9850-31be915d55bf tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/ad6b8a2c-7c9a-4d59-8aac-eb74423ace17" status: 200 len: 350 microversion: 2.1 time: 0.104990 Sep 19 11:25:05.084722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 12/30] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:25:04 2022] GET /compute/v2.1/os-volumes/ad6b8a2c-7c9a-4d59-8aac-eb74423ace17 => generated 350 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:05.084722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5441ada1-85cf-42c7-9a3e-f0f8643d636a tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9a9e7d30>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:05.148156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-5441ada1-85cf-42c7-9a3e-f0f8643d636a tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] HTTP exception thrown: Snapshot d9d24da3-1a4d-4779-b495-26251d32497e could not be found. Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5441ada1-85cf-42c7-9a3e-f0f8643d636a tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Request method failure captured: Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e HTTP/1.1 Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGFjZDprd1aLiBxj3AB_kVj2OqdQ-YuFldYYPtzPlw6TGaahTdmPK8eJSF3-C93QicAiH_uQhRxKECyVSiXIMV8jnHyygiY_IxJvbW-NIR7BgmgAPcPKWKmNBuZBw7Cs5acWd-YSuplVou85znLixWfJ1MVf9BQTI6CP4g5QUq9D00 Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:25:05.150953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4a4d4f493712488190cba8e9edcabf5b Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Snapshot d9d24da3-1a4d-4779-b495-26251d32497e could not be found. Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': 'd9d24da3-1a4d-4779-b495-26251d32497e'} Sep 19 11:25:05.152743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot d9d24da3-1a4d-4779-b495-26251d32497e could not be found. (HTTP 404) (Request-ID: req-af4145c8-75e0-4b00-bb9b-29ffd6534715) Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:05.153454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:05.154387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot d9d24da3-1a4d-4779-b495-26251d32497e could not be found. Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 19 11:25:05.155428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot d9d24da3-1a4d-4779-b495-26251d32497e could not be found. Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot d9d24da3-1a4d-4779-b495-26251d32497e could not be found. Sep 19 11:25:05.156395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:05.159083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5441ada1-85cf-42c7-9a3e-f0f8643d636a tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Returning 404 to user: Snapshot d9d24da3-1a4d-4779-b495-26251d32497e could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:25:05.160211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5441ada1-85cf-42c7-9a3e-f0f8643d636a tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e" status: 404 len: 111 microversion: 2.1 time: 0.082632 Sep 19 11:25:05.160993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 13/31] 10.222.0.78 () {58 vars in 1251 bytes} [Mon Sep 19 11:25:05 2022] GET /compute/v2.1/os-snapshots/d9d24da3-1a4d-4779-b495-26251d32497e => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:25:05.172069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9d6a7a55-8f5d-47a9-9be4-42bb00a00372 tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9a9e7f70>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:05.221242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3c33e259-783a-4ee5-8c65-e5dccf2d7272 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:05.261763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3c33e259-783a-4ee5-8c65-e5dccf2d7272 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1222 microversion: 2.1 time: 0.411572 Sep 19 11:25:05.262811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 19/32] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:04 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1222 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:05.270066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0d275b14-3954-4efc-925b-b5937adddf42 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2eeee0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:05.354276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9d6a7a55-8f5d-47a9-9be4-42bb00a00372 tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.191998 Sep 19 11:25:05.356137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 14/33] 10.222.0.78 () {58 vars in 1134 bytes} [Mon Sep 19 11:25:05 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:05.380111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cc07fad5-e4d0-41f7-9dfc-b9374c552742 tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9a9ff040>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:05.687287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0d275b14-3954-4efc-925b-b5937adddf42 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4" status: 202 len: 0 microversion: 2.1 time: 0.423070 Sep 19 11:25:05.691222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 20/34] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 11:25:05 2022] DELETE /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 => generated 0 bytes in 425 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:25:05.698219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-874349070", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:05.965216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cc07fad5-e4d0-41f7-9dfc-b9374c552742 tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.589504 Sep 19 11:25:05.966088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 15/35] 10.222.0.78 () {58 vars in 1149 bytes} [Mon Sep 19 11:25:05 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 591 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:05.973883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42ae2468-529b-4e6e-81ea-08ee6e5840a2 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9aa0db80>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:05.998417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] validate_networks() for [('f8725e24-32ff-48e9-8c98-5e2c3e121e45', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:25:06.163702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42ae2468-529b-4e6e-81ea-08ee6e5840a2 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4" status: 200 len: 345 microversion: 2.1 time: 0.195500 Sep 19 11:25:06.164286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 16/36] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:25:05 2022] GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 => generated 345 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:06.170728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-16106cac-53df-4533-9f11-317890dd3f45 tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9aa0d790>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:06.615509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-16106cac-53df-4533-9f11-317890dd3f45 tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.449974 Sep 19 11:25:06.616236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 17/37] 10.222.0.78 () {58 vars in 1134 bytes} [Mon Sep 19 11:25:06 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:07.254037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-485297964", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "networks": [{"uuid": "f2812bee-46c4-46c1-bb26-bcfb036c902b"}]}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:07.348244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] validate_networks() for [('f2812bee-46c4-46c1-bb26-bcfb036c902b', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:25:08.260404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:25:08.260911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:25:08.261857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:25:08.262340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:25:08.263398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:25:08.287072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:25:08.287579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:25:08.288005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:25:08.288425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:25:08.288854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:25:08.292823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:08.293577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:08.294304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:08.295499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:08.296195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:08.296981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:08.299100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:08.301979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:08.301979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:08.301979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:08.301979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:08.302702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:08.332009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Getting quotas for project 089d6ade5a3d4e48868bc6cc190c6251. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:08.349581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:08.356460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Getting quotas for user eec3ef0842b948deb7ecc46f7c56dd04 and project 089d6ade5a3d4e48868bc6cc190c6251. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:08.359958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for user d6fee905418f4d879da460b6758d4f23 and project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:08.381972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:25:08.384100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:25:08.388739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:25:08.392882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:25:08.663675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a528be4a-1b9f-4743-88dd-04d9cbac7b05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.973640 Sep 19 11:25:08.664609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 21/38] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:25:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 2976 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:25:08.671072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2218a1e6-ac05-49d3-8614-556fda2b617e tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9b212820>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:08.677435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e4de37f1-97bc-4f6f-8a31-95ccf9073339 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.059742 Sep 19 11:25:08.678621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 18/39] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:25:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 2061 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:25:08.685456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c79bfec7-5fbe-4cc2-910d-47dd42991379 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b2ecf70>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:08.815751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2218a1e6-ac05-49d3-8614-556fda2b617e tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.149343 Sep 19 11:25:08.816645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 22/40] 10.222.0.78 () {58 vars in 1167 bytes} [Mon Sep 19 11:25:08 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-c79bfec7-5fbe-4cc2-910d-47dd42991379 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] HTTP exception thrown: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c79bfec7-5fbe-4cc2-910d-47dd42991379 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Request method failure captured: Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 HTTP/1.1 Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGFjZDprd1aLiBxj3AB_kVj2OqdQ-YuFldYYPtzPlw6TGaahTdmPK8eJSF3-C93QicAiH_uQhRxKECyVSiXIMV8jnHyygiY_IxJvbW-NIR7BgmgAPcPKWKmNBuZBw7Cs5acWd-YSuplVou85znLixWfJ1MVf9BQTI6CP4g5QUq9D00 Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:25:08.974100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4a4d4f493712488190cba8e9edcabf5b Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '85a9249a-c8da-442e-bf15-89a4d8e9eba4'} Sep 19 11:25:08.976602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. (HTTP 404) (Request-ID: req-d68ff09e-5a3c-4465-b7e6-9adf96fd1f49) Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:08.977572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:08.978538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:25:08.982515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c79bfec7-5fbe-4cc2-910d-47dd42991379 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Returning 404 to user: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c79bfec7-5fbe-4cc2-910d-47dd42991379 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4" status: 404 len: 109 microversion: 2.1 time: 0.257162 Sep 19 11:25:08.983927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 19/41] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:25:08 2022] GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 => generated 109 bytes in 258 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:25:08.985298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d7432999-4152-47db-9584-5c77cb483dc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:08.985298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d7432999-4152-47db-9584-5c77cb483dc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:09.122634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d7432999-4152-47db-9584-5c77cb483dc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:09.170121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d7432999-4152-47db-9584-5c77cb483dc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1221 microversion: 2.1 time: 0.231055 Sep 19 11:25:09.173324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 20/42] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:08 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1221 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:09.186581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5dc56426-4f1d-4b81-80dc-1d37015ded42 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:09.190257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5dc56426-4f1d-4b81-80dc-1d37015ded42 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:09.281995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5dc56426-4f1d-4b81-80dc-1d37015ded42 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:09.291645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5dc56426-4f1d-4b81-80dc-1d37015ded42 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1214 microversion: 2.1 time: 0.115895 Sep 19 11:25:09.292783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 21/43] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:09 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1214 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:09.299031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c1513d25-e915-42cf-bdea-e13086fd10ab tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9a9b7c10>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:09.381359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-67765721-97a6-436d-acbb-454371895c78 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'create', calling method: .version_select at 0x7f4b9b212dc0>, body: {"keypair": {"name": "tempest-keypair-620316827", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBHBWom7YE57I4xeW+a+XQVa+NmLQP1QvPtih9IVxJx+SFyl5Ekt5sSAOPau4Hz81C/UBOwLlEyVvgRVay/Ii/Da1yKzhQlK8MFhjKSHRSCnVujQGf612dmPuJkalgJrYg=="}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:09.437020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-67765721-97a6-436d-acbb-454371895c78 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for project 4767407e0fb04faaaa3a520128aa88df. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:09.452840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-67765721-97a6-436d-acbb-454371895c78 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for user 405b3189506a44bc93555c40917b4cbe and project 4767407e0fb04faaaa3a520128aa88df. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:09.470455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c1513d25-e915-42cf-bdea-e13086fd10ab tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.176568 Sep 19 11:25:09.471030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 22/44] 10.222.0.78 () {58 vars in 1170 bytes} [Mon Sep 19 11:25:09 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:09.477920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7503edb-3e4f-4d83-a74c-714772569d98 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9a9b7a60>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:09.539660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-a7503edb-3e4f-4d83-a74c-714772569d98 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] HTTP exception thrown: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7503edb-3e4f-4d83-a74c-714772569d98 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Request method failure captured: Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 HTTP/1.1 Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGFjZDprd1aLiBxj3AB_kVj2OqdQ-YuFldYYPtzPlw6TGaahTdmPK8eJSF3-C93QicAiH_uQhRxKECyVSiXIMV8jnHyygiY_IxJvbW-NIR7BgmgAPcPKWKmNBuZBw7Cs5acWd-YSuplVou85znLixWfJ1MVf9BQTI6CP4g5QUq9D00 Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:25:09.540716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4a4d4f493712488190cba8e9edcabf5b Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '85a9249a-c8da-442e-bf15-89a4d8e9eba4'} Sep 19 11:25:09.542054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. (HTTP 404) (Request-ID: req-9ad9e88f-d901-4bc0-aeae-ce98691fc408) Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:09.542945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 19 11:25:09.544408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 19 11:25:09.545602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7503edb-3e4f-4d83-a74c-714772569d98 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Returning 404 to user: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7503edb-3e4f-4d83-a74c-714772569d98 tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "DELETE /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4" status: 404 len: 109 microversion: 2.1 time: 0.071615 Sep 19 11:25:09.546733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 23/45] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 11:25:09 2022] DELETE /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:25:09.555693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ae0dfd21-af2f-4b6a-b329-f10e42e9d8ee tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9aa0d9d0>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:09.612680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-67765721-97a6-436d-acbb-454371895c78 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.775264 Sep 19 11:25:09.613396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 23/46] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 11:25:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:09.643520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9eacfab8-f94c-4e9a-b6e6-124e47e00ccc tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Calling method '.version_select at 0x7f4b9b212ee0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:09.720162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ae0dfd21-af2f-4b6a-b329-f10e42e9d8ee tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.168887 Sep 19 11:25:09.720930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 24/47] 10.222.0.78 () {58 vars in 1155 bytes} [Mon Sep 19 11:25:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:09.741438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc98f3c9-f0ea-42f3-9184-93ac93d7755b tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9a9b7430>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:09.774393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-9eacfab8-f94c-4e9a-b6e6-124e47e00ccc tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] HTTP exception thrown: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9eacfab8-f94c-4e9a-b6e6-124e47e00ccc tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Request method failure captured: Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 HTTP/1.1 Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGFjZDprd1aLiBxj3AB_kVj2OqdQ-YuFldYYPtzPlw6TGaahTdmPK8eJSF3-C93QicAiH_uQhRxKECyVSiXIMV8jnHyygiY_IxJvbW-NIR7BgmgAPcPKWKmNBuZBw7Cs5acWd-YSuplVou85znLixWfJ1MVf9BQTI6CP4g5QUq9D00 Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:25:09.778442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0f6f09e176314205bbad48d0d0a382b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 0f6f09e176314205bbad48d0d0a382b3 Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1468448422 Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 4a4d4f493712488190cba8e9edcabf5b Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1468448422-project Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '85a9249a-c8da-442e-bf15-89a4d8e9eba4'} Sep 19 11:25:09.785539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. (HTTP 404) (Request-ID: req-b01dbcef-764d-4dc0-b104-fded49de3837) Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:09.786617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 19 11:25:09.787791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 19 11:25:09.789484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9eacfab8-f94c-4e9a-b6e6-124e47e00ccc tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] Returning 404 to user: Volume 85a9249a-c8da-442e-bf15-89a4d8e9eba4 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9eacfab8-f94c-4e9a-b6e6-124e47e00ccc tempest-VolumesSnapshotsTestJSON-1468448422 tempest-VolumesSnapshotsTestJSON-1468448422-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4" status: 404 len: 109 microversion: 2.1 time: 0.165155 Sep 19 11:25:09.791797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 24/48] 10.222.0.78 () {58 vars in 1245 bytes} [Mon Sep 19 11:25:09 2022] GET /compute/v2.1/os-volumes/85a9249a-c8da-442e-bf15-89a4d8e9eba4 => generated 109 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:25:09.899899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc98f3c9-f0ea-42f3-9184-93ac93d7755b tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.166603 Sep 19 11:25:09.900596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 25/49] 10.222.0.78 () {58 vars in 1188 bytes} [Mon Sep 19 11:25:09 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:09.916880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1abaa146-e874-4fb6-94ae-fea9da8729de tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] Calling method '.version_select at 0x7f4b9a9cbb80>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:10.198830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-af31484c-32c8-4306-a023-4e022c817f10 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:10.200100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-af31484c-32c8-4306-a023-4e022c817f10 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:10.211748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1abaa146-e874-4fb6-94ae-fea9da8729de tempest-VolumesTestJSON-995055395 tempest-VolumesTestJSON-995055395-project] 10.222.0.78 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.299830 Sep 19 11:25:10.212526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 25/50] 10.222.0.78 () {58 vars in 1155 bytes} [Mon Sep 19 11:25:09 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:10.315741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0b97350d-8250-4af1-a7bb-3f42f609e42f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:10.316679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0b97350d-8250-4af1-a7bb-3f42f609e42f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:10.334170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-af31484c-32c8-4306-a023-4e022c817f10 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:10.357321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-af31484c-32c8-4306-a023-4e022c817f10 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1221 microversion: 2.1 time: 0.164996 Sep 19 11:25:10.360502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 26/51] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:10 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1221 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:10.415416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0b97350d-8250-4af1-a7bb-3f42f609e42f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:10.451477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0b97350d-8250-4af1-a7bb-3f42f609e42f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1214 microversion: 2.1 time: 0.139176 Sep 19 11:25:10.456193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 26/52] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:10 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1214 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:11.380886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:11.382211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:11.390155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:11.403594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:11.404460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:11.405457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:11.406188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:11.406774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:11.484725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:11.489379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:11.524451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:11.528083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:11.530033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:11.533473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:11.541736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:11.542471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:11.720354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:11.761367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6f488e47-95d3-48f3-bb33-3b2c7f07a4f1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1217 microversion: 2.1 time: 0.383878 Sep 19 11:25:11.777820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 27/53] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:11 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1217 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:11.891936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:11.906773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dc869aff-89b8-4b97-9d0a-f078ac28b24f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1218 microversion: 2.1 time: 0.427498 Sep 19 11:25:11.908381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 27/54] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:11 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1218 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:12.802360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:12.804137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:12.828537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:12.830293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:12.830962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:12.832016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:12.832808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:12.833396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:12.931244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:12.931950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:12.958707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:12.962978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:12.967287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:12.971225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:12.973301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:12.976307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:13.031352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:13.039238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2b7773d2-b9ec-4417-b23c-a5cb7fc9f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1273 microversion: 2.1 time: 0.241637 Sep 19 11:25:13.059660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 28/55] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:12 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1273 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:13.164595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:13.182923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-477a1483-1b01-49f7-831e-4959b8d0a4a2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1210 microversion: 2.1 time: 0.256170 Sep 19 11:25:13.201035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 28/56] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:12 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1210 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:14.067771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:14.068309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:14.083027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:14.083629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:14.084093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:14.084854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:14.085336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:14.091197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:14.219726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:14.221120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:14.236097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:14.237939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:14.238491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:14.240125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:14.242743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:14.243312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:14.886298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:14.918107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-927d4272-901e-4887-95c6-1dc880deec45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1279 microversion: 2.1 time: 0.833208 Sep 19 11:25:14.927922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 29/57] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:14 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1279 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:14.935672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:14.967761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e0b649bb-ddee-4e98-9774-a7439421745c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1274 microversion: 2.1 time: 0.753743 Sep 19 11:25:14.996657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 29/58] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:14 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1274 bytes in 783 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:15.952280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:15.953051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:15.967066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:15.968557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:15.969112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:15.971872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:15.972540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:15.975420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:16.013597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:16.014381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:16.029394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:16.034781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:16.035583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:16.038169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:16.040045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:16.044451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:16.282895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:16.291410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:16.304597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-73e4ee89-f571-42ad-af4e-6945a59c4100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1279 microversion: 2.1 time: 0.357965 Sep 19 11:25:16.310371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 30/59] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:15 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1279 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:16.310612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b4cfac1c-0743-44d2-bb5b-ab9407c4e92c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1272 microversion: 2.1 time: 0.298056 Sep 19 11:25:16.311254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 30/60] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:16 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:16.909970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-375952227", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bade7eef-3602-4313-86ff-efde9395cb00"}], "security_groups": [{"name": "tempest-securitygroup--526035421"}], "key_name": "tempest-keypair-620316827", "user_data": "}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:17.343204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:17.346765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:17.354091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:17.354883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:17.356059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:17.358031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:17.358548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:17.359366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:17.379401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] validate_networks() for [('bade7eef-3602-4313-86ff-efde9395cb00', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:25:18.152739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:18.163743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4beae476-bfa2-4113-a804-96665ebb7fec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.825995 Sep 19 11:25:18.180105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 31/61] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:17 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 847 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:18.200848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:18.203749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:18.221159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.223812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.224347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.225148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:18.227723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:18.229027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:18.313041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:18.340512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:19.707649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:19.714721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-873f0c3d-f644-4ce4-a908-2166a0f61d49 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 1.533262 Sep 19 11:25:19.715660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 32/62] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:18 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 1535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:19.721276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:19.721882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:19.735512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:19.735512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:19.735512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:19.735512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:19.738479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:19.739335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:20.071319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:20.082733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7a4d7f84-4bc1-4bdd-8fe6-1dda17b8359b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.365828 Sep 19 11:25:20.083451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 33/63] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:19 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:20.091004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:25:20.092420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:25:20.092973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:25:20.096952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:25:20.096952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:25:20.123760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:20.126504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:20.126504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:20.126504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:20.126504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:20.126905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:20.179133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for project 4767407e0fb04faaaa3a520128aa88df. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:25:20.191132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for user 405b3189506a44bc93555c40917b4cbe and project 4767407e0fb04faaaa3a520128aa88df. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:25:20.226896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:25:20.230926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:25:20.443329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=14 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:20.486813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-777d2b9c-6872-46ac-807e-7b1d74bf408b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.579730 Sep 19 11:25:20.490176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 31/64] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:25:16 2022] POST /compute/v2.1/servers => generated 401 bytes in 3585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 11:25:20.501963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1ab1c62f-43b4-497a-9c7e-8698742c81db tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:20.503735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1ab1c62f-43b4-497a-9c7e-8698742c81db tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:20.806269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1ab1c62f-43b4-497a-9c7e-8698742c81db tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:20.816939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1ab1c62f-43b4-497a-9c7e-8698742c81db tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1236 microversion: 2.1 time: 0.320427 Sep 19 11:25:20.834922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 32/65] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:20 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1236 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:20.860457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:20.864497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:20.883973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:20.885034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:20.886352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:20.898131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:20.898131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:20.898131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.039230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-3c19393b-12fa-438e-b9a9-1f726f560c02 req-56987b52-0136-4b8e-86a9-2a86b86e6d68 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "844fd60f-68da-4b43-a8d2-fae5e0a6cf45", "tag": "291f03b6-9596-4181-8c7c-5524563b0f56"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:21.082190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-3c19393b-12fa-438e-b9a9-1f726f560c02 req-56987b52-0136-4b8e-86a9-2a86b86e6d68 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:21.082708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-3c19393b-12fa-438e-b9a9-1f726f560c02 req-56987b52-0136-4b8e-86a9-2a86b86e6d68 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:21.083154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-3c19393b-12fa-438e-b9a9-1f726f560c02 req-56987b52-0136-4b8e-86a9-2a86b86e6d68 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.141848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-3c19393b-12fa-438e-b9a9-1f726f560c02 req-56987b52-0136-4b8e-86a9-2a86b86e6d68 service nova] Creating event network-changed:291f03b6-9596-4181-8c7c-5524563b0f56 for instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 on hv-cinder-82282 Sep 19 11:25:21.149637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-3c19393b-12fa-438e-b9a9-1f726f560c02 req-56987b52-0136-4b8e-86a9-2a86b86e6d68 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 11:25:21.150312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-3c19393b-12fa-438e-b9a9-1f726f560c02 req-56987b52-0136-4b8e-86a9-2a86b86e6d68 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 11:25:21.151810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82df9baf-349f-4553-aaad-677207702889 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:21.152608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82df9baf-349f-4553-aaad-677207702889 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:21.153278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82df9baf-349f-4553-aaad-677207702889 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.154192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82df9baf-349f-4553-aaad-677207702889 None None] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:21.156887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82df9baf-349f-4553-aaad-677207702889 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:21.158273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82df9baf-349f-4553-aaad-677207702889 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.183124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.compute.rpcapi [None req-82df9baf-349f-4553-aaad-677207702889 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 11:25:21.184518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82df9baf-349f-4553-aaad-677207702889 None None] Releasing lock "compute-rpcapi-router" {{(pid=121084) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 11:25:21.206254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-82df9baf-349f-4553-aaad-677207702889 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.121395 Sep 19 11:25:21.206871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 34/66] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:21.222590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:21.224094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:21.237548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:21.238320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:21.239621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.240561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:21.241190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:21.242027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:21.540507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:21.553255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-74c82f37-757e-489f-88a8-018dc96dd0aa tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.723499 Sep 19 11:25:21.554334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 33/67] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:20 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:21.860962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-313f96c8-610f-488b-8439-38b3902c2138 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:21.860962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-313f96c8-610f-488b-8439-38b3902c2138 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:22.039228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:22.052131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5e7ab403-f887-4068-ae1d-62cc8c6b6052 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.840546 Sep 19 11:25:22.056529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 35/68] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:21 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 848 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:22.146815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-313f96c8-610f-488b-8439-38b3902c2138 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:22.162825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-313f96c8-610f-488b-8439-38b3902c2138 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1236 microversion: 2.1 time: 0.309446 Sep 19 11:25:22.163676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 34/69] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:21 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1236 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:22.598428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:22.599138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:22.614110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:22.614459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:22.615066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:22.616310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:22.618235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:22.618839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:22.720064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-5ea25084-ae12-4036-9830-27f780a264e8 req-cd7d4279-74b4-47fa-a583-c75922acfd4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f892bd2-0650-4e0b-b0cf-4c101d48c1e1", "tag": "6ac5a146-2fb2-4d85-bf90-5543fd4e51e7"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:22.731133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-5ea25084-ae12-4036-9830-27f780a264e8 req-cd7d4279-74b4-47fa-a583-c75922acfd4c service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:22.732519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-5ea25084-ae12-4036-9830-27f780a264e8 req-cd7d4279-74b4-47fa-a583-c75922acfd4c service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:22.733126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-5ea25084-ae12-4036-9830-27f780a264e8 req-cd7d4279-74b4-47fa-a583-c75922acfd4c service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:22.746488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-5ea25084-ae12-4036-9830-27f780a264e8 req-cd7d4279-74b4-47fa-a583-c75922acfd4c service nova] Creating event network-changed:6ac5a146-2fb2-4d85-bf90-5543fd4e51e7 for instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 on hv-cinder-82282 Sep 19 11:25:22.756234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-5ea25084-ae12-4036-9830-27f780a264e8 req-cd7d4279-74b4-47fa-a583-c75922acfd4c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.556505 Sep 19 11:25:22.756234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 36/70] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:25:22.939290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:22.961682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0c848a57-643a-4137-9bd3-fee355c6d700 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.367335 Sep 19 11:25:22.963125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 35/71] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:22 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:23.088048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:23.090409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:23.101938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:23.102995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:23.103740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:23.104800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:23.105493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:23.106134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:23.188395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:23.189484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:23.202910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:23.203437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:23.203871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:23.204722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:23.205181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:23.205600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:23.758845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:23.772696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bc6a716f-b7b2-4090-b0eb-7a4d429386bf tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1240 microversion: 2.1 time: 0.588133 Sep 19 11:25:23.773833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 36/72] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:23 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1240 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:23.780518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-bd874388-9255-48de-85e6-82195fd26a8d req-0c71d414-7bd9-4faf-9aed-53f01b205a23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33f432e6-7d1d-43a6-9073-2603faabd4f7", "tag": "0b1fae1c-cd4d-422b-94f6-900878d04a07"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:23.797062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bd874388-9255-48de-85e6-82195fd26a8d req-0c71d414-7bd9-4faf-9aed-53f01b205a23 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:23.802805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bd874388-9255-48de-85e6-82195fd26a8d req-0c71d414-7bd9-4faf-9aed-53f01b205a23 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:23.804988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bd874388-9255-48de-85e6-82195fd26a8d req-0c71d414-7bd9-4faf-9aed-53f01b205a23 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:23.882212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-bd874388-9255-48de-85e6-82195fd26a8d req-0c71d414-7bd9-4faf-9aed-53f01b205a23 service nova] Creating event network-changed:0b1fae1c-cd4d-422b-94f6-900878d04a07 for instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 on hv-cinder-82282 Sep 19 11:25:23.890909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bd874388-9255-48de-85e6-82195fd26a8d req-0c71d414-7bd9-4faf-9aed-53f01b205a23 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 19 11:25:23.897480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bd874388-9255-48de-85e6-82195fd26a8d req-0c71d414-7bd9-4faf-9aed-53f01b205a23 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 19 11:25:23.898310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:23.899843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:23.903269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:23.904316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:23.907417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:23.908075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:23.939312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.compute.rpcapi [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 19 11:25:23.949039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] Releasing lock "compute-rpcapi-router" {{(pid=121085) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 19 11:25:23.968164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-186819a4-34a6-46bd-b9ac-a82cf3091869 None None] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191087 Sep 19 11:25:23.970551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 37/73] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:23.996104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:23.996104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:24.010158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:24.011727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:24.012377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:24.013295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:24.014271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:24.015083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:24.081050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:24.125168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3a9b8d5-4604-45f2-806a-0f1a80a3fced tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 1.038865 Sep 19 11:25:24.129706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 37/74] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:23 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 1050 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:24.627460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:24.636155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-252c8e9e-dc28-4854-a4ce-2d1c3a4077ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.646873 Sep 19 11:25:24.655952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 38/75] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:23 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:24.801264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:24.802168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:24.816225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:24.821351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:24.823961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:24.828368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:24.834467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:24.834467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:24.996180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:25.040011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f97e7afd-17e5-49b9-88dc-a89241cf51a3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1288 microversion: 2.1 time: 0.243139 Sep 19 11:25:25.044364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 38/76] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:24 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1288 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:25.169382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:25.170512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:25.177269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=9 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:25.185917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:25.188468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:25.189998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:25.190941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:25.191655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:25.192591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:25.409274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:25.427055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-46364795-bdec-4e21-9686-83d27977fbaf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.273651 Sep 19 11:25:25.439707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 39/77] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:25 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:25.662312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:25.663704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:25.676633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:25.679006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:25.681855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:25.683554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:25.685814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:25.687197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:25.905620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:25.913643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-24e38d92-24ad-435b-a409-e561cb7c4012 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.255649 Sep 19 11:25:25.914234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 39/78] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:25 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:26.072354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:26.073432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:26.079679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:26.080497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:26.081107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:26.081803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:26.082346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:26.082866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:26.203801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:26.213141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4cce164b-63c1-4559-8e6e-2923ded37e60 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1288 microversion: 2.1 time: 0.145953 Sep 19 11:25:26.220620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 40/79] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:26 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1288 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:26.451968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:26.452555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:26.458752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:26.459321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:26.459797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:26.460540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:26.461000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:26.461430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:26.629519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:26.629519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3d3fb060-fde5-4588-9449-22404d1234ab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.167265 Sep 19 11:25:26.629519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 40/80] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:26 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:26.938865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:26.939717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:26.949574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:26.950418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:26.951018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:26.952081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:26.952691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:26.953280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:27.225235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:27.245440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:27.247340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:27.249992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d4ad0aee-769d-49d7-8076-2f33fdc8873d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.315453 Sep 19 11:25:27.257509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:27.259308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:27.259410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 41/81] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:26 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:27.259494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:27.265881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:27.266637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:27.267546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:27.394458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:27.402955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d4a1721a-8914-4c01-b0bc-eb577d7ebb58 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1288 microversion: 2.1 time: 0.162389 Sep 19 11:25:27.403564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 41/82] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:27 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1288 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:27.638261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:27.639014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:27.646396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:27.647437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:27.651342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:27.652986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:27.653623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:27.654209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:27.921987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:27.932782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7941eff8-6604-4da2-98d3-28ea128a8898 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.298635 Sep 19 11:25:27.953225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 42/83] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:27 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:28.274301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:28.274902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:28.290295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.292202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.293359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:28.294233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.294845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.295445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:28.427018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:28.427806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:28.440210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.441880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.442443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:28.443217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.444465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.446693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:28.451218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:28.460458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d8643123-bfdc-4adc-b2c7-ba290ecf2f43 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.189827 Sep 19 11:25:28.461770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 42/84] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:28 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:28.548712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:28.557292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7689d394-5e1a-4677-b392-2ebf1e8e1449 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1288 microversion: 2.1 time: 0.134595 Sep 19 11:25:28.572849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 43/85] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:28 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1288 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:28.967376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:28.972536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:28.981633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.982754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.983466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:28.984455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:28.985024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:28.985603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.138835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:29.147131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-90e2e4d5-ee3c-43fc-b1ca-c6ae8b465f65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.189878 Sep 19 11:25:29.148516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 43/86] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:28 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:29.485993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:29.486621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:29.493182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:29.493872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:29.494304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.495741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:29.496194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:29.496784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.585094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:29.585911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:29.595379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:29.596219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:29.596671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.597389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:29.597841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:29.599828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:29.629868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:29.678957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:29.683257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:29.687380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-71121da8-c25e-493d-aa9c-5b1707bc8721 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1296 microversion: 2.1 time: 0.106207 Sep 19 11:25:29.687964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 44/87] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:29 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1296 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:29.691255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e15fe42e-832d-40b1-b754-4383af28705f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.209057 Sep 19 11:25:29.691811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 44/88] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:29 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:30.170724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:30.171282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:30.177185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.177662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.178095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.178770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.179245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.179671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.353193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:30.364162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d71c0fbe-5f96-45ae-addf-904691b4a510 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.197188 Sep 19 11:25:30.379878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 45/89] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:30 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:30.711811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:30.712476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:30.714658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:30.716511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:30.725131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.726289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.727132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.728686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.729381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.731804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.732587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.732697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.734310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.736872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:30.737363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:30.737807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:30.825440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:30.827676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:30.832732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8fbbf18a-0bc6-44ea-93f3-8dacfce5837c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1296 microversion: 2.1 time: 0.125798 Sep 19 11:25:30.833871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 45/90] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:30 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1296 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:30.942966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:30.951301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f740d3cd-0635-4bb1-b097-852f74b165f3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.241145 Sep 19 11:25:30.952237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 46/91] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:30 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:31.388591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:31.389456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:31.396252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:31.401162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:31.401162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:31.401162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:31.401162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:31.401585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:31.589349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:31.597442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eef4557e-5197-4d9c-bea0-0135bd88aace tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.212668 Sep 19 11:25:31.598028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 46/92] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:31 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:31.857331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:31.858646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:31.861563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:31.869018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:31.870356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:31.870982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:31.871841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:31.872218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:31.872821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:31.993010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:31.993777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:32.002311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.006502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.007388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.008375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.009175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.010973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.079973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:32.097140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1337e88c-d62f-43c8-b0b2-e41319496c40 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.241758 Sep 19 11:25:32.097904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 47/93] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:31 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:32.152876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=28 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:32.290928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:32.301146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c3463f87-844a-47cd-afc6-417c2f2ac757 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.322819 Sep 19 11:25:32.301886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 47/94] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:31 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:32.621722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:32.622347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:32.634749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.634749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.634749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.637327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:32.638098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:32.640369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:32.851202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:32.860656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f5b5c72e-3d9f-4e01-af08-454a4231ca83 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.243271 Sep 19 11:25:32.868241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 48/95] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:32 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:33.138048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:33.138664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:33.159607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.160216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.160744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.161531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.162073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.162581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.327546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:33.328361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:33.341907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.342415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.342859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.343598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.344062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.344492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.455528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:33.466844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-19a25278-500b-467b-8a27-c9f3d1c65ab4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.340226 Sep 19 11:25:33.467786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 48/96] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:33 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:33.528805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:33.539726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-057f48c3-2043-4bc2-8bb8-f282cd9bad0f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.218252 Sep 19 11:25:33.540527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 49/97] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:33 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:33.616983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-de5750ba-5a03-4f5f-ba0e-c768c04a0754 req-a5d1ae20-e4db-4848-bc09-bb115bf5ba72 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c2424a-e9d7-4e1c-918a-f7b718b4fd0d", "tag": "1e00f0af-d58e-4616-b88f-cf53edaabac1"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:33.627999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-de5750ba-5a03-4f5f-ba0e-c768c04a0754 req-a5d1ae20-e4db-4848-bc09-bb115bf5ba72 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.628558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-de5750ba-5a03-4f5f-ba0e-c768c04a0754 req-a5d1ae20-e4db-4848-bc09-bb115bf5ba72 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.629251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-de5750ba-5a03-4f5f-ba0e-c768c04a0754 req-a5d1ae20-e4db-4848-bc09-bb115bf5ba72 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.643339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-de5750ba-5a03-4f5f-ba0e-c768c04a0754 req-a5d1ae20-e4db-4848-bc09-bb115bf5ba72 service nova] Creating event network-changed:1e00f0af-d58e-4616-b88f-cf53edaabac1 for instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d on hv-cinder-82282 Sep 19 11:25:33.649402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-de5750ba-5a03-4f5f-ba0e-c768c04a0754 req-a5d1ae20-e4db-4848-bc09-bb115bf5ba72 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037291 Sep 19 11:25:33.653329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 49/98] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:33.886261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:33.887717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:33.903264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:33.903264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.903264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.903264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:33.903719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:33.903719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:33.905342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.182334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:34.207516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6432d24c-4a45-486f-9046-73d6246e72b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.312137 Sep 19 11:25:34.207516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 50/99] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:33 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:34.217415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:34.324010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-afb25d2a-b0a6-4869-b5d2-71957b46354b req-df49a89d-c10b-44fc-8a08-f8c9b787c95b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "844fd60f-68da-4b43-a8d2-fae5e0a6cf45", "name": "network-vif-plugged", "status": "completed", "tag": "291f03b6-9596-4181-8c7c-5524563b0f56"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:34.336425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-afb25d2a-b0a6-4869-b5d2-71957b46354b req-df49a89d-c10b-44fc-8a08-f8c9b787c95b service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.337795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-afb25d2a-b0a6-4869-b5d2-71957b46354b req-df49a89d-c10b-44fc-8a08-f8c9b787c95b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.338566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-afb25d2a-b0a6-4869-b5d2-71957b46354b req-df49a89d-c10b-44fc-8a08-f8c9b787c95b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.361488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-afb25d2a-b0a6-4869-b5d2-71957b46354b req-df49a89d-c10b-44fc-8a08-f8c9b787c95b service nova] Creating event network-vif-plugged:291f03b6-9596-4181-8c7c-5524563b0f56 for instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 on hv-cinder-82282 Sep 19 11:25:34.367544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-afb25d2a-b0a6-4869-b5d2-71957b46354b req-df49a89d-c10b-44fc-8a08-f8c9b787c95b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151919 Sep 19 11:25:34.368401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 50/100] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:25:34.489983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:34.490664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:34.497271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.497764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.498198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.498909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.499400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.500129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.565285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:34.565285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:34.570876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.571410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.572177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.573143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:34.573811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:34.574427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:34.767351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:34.778218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-661e8fcf-e42d-454b-ae93-49f631057f70 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.292028 Sep 19 11:25:34.778973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 51/101] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:34 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:34.795757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:34.802845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-087fd418-3768-4fab-a6cc-a5dfddb4e42c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.243194 Sep 19 11:25:34.803475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 51/102] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:34 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:35.216805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:35.217434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:35.224444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.225183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.225825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.226698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.227340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.227925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.450874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:35.469926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fa54a346-dae4-40da-8f8a-9b6f4bf226cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.257250 Sep 19 11:25:35.470559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 52/103] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:35 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:35.801881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:35.802946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:35.810615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.811425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.811941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.812708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.813430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.813909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.826188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:35.827764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:35.836973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.837750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.838453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:35.839517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:35.840257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:35.842135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:36.123466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:36.124285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:36.131888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-76aaa006-8a1e-4b09-88c3-aad419561f62 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.310287 Sep 19 11:25:36.132620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-edb18db1-aabb-4673-958a-8ea1af7bd331 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.334703 Sep 19 11:25:36.136160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 53/104] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:35 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:36.136267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 52/105] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:35 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:36.497088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:36.497748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:36.503823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:36.504307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:36.504740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:36.505441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:36.505899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:36.506323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:36.644554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:36.654105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-781ba3a5-89ca-4e53-ab01-6e2ace6c73e4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.160864 Sep 19 11:25:36.654684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 54/106] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:36 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:37.156851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:37.165906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:37.166670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:37.167908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:37.178956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.181855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.182444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.182957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.183870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.184584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.192849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.193029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.193682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.194338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.197924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.198773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.450692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:37.454085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:37.465281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0d6d173b-52bc-4506-9045-5e8b612b5c4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.312228 Sep 19 11:25:37.469993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-266447b5-1329-4855-9bd2-052c66a51935 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.318865 Sep 19 11:25:37.474480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 53/107] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:37 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:37.486731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 55/108] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:37 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:37.680847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:37.682857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:37.690576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.691408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.692755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.697901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:37.697901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:37.697901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:37.909707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:37.924380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-24931856-8a76-4687-b21f-b55b10fee34d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.248878 Sep 19 11:25:37.925733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 54/109] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:37 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:38.491577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:38.492822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:38.497709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:38.497709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:38.499331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.500267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.500897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.501737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.502731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.503499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.505284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.505911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.506456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.507817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.508853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.508853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.730122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:38.735439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:38.738705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cee34c5a-87fa-405e-8255-9ee48297b4b2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.252416 Sep 19 11:25:38.739373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 56/110] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:38 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:38.760373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e197fe01-74e4-4e63-af81-b00baf994354 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.267504 Sep 19 11:25:38.760963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 55/111] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:38 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:38.968617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:38.969809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:38.979989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.980506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.980936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:38.981793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:38.982258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:38.982684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.129626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:39.138440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-89b3de9e-1dac-41a2-893d-a46fc996e2e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.181830 Sep 19 11:25:39.139208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 57/112] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:38 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:39.510859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-bc70cff1-a9d3-4613-88eb-38cf0c0773b5 req-573daaaa-deec-4491-ab73-b7edad41b197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f892bd2-0650-4e0b-b0cf-4c101d48c1e1", "name": "network-vif-plugged", "status": "completed", "tag": "6ac5a146-2fb2-4d85-bf90-5543fd4e51e7"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:39.533103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bc70cff1-a9d3-4613-88eb-38cf0c0773b5 req-573daaaa-deec-4491-ab73-b7edad41b197 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.533615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bc70cff1-a9d3-4613-88eb-38cf0c0773b5 req-573daaaa-deec-4491-ab73-b7edad41b197 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.534054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bc70cff1-a9d3-4613-88eb-38cf0c0773b5 req-573daaaa-deec-4491-ab73-b7edad41b197 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.552265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-bc70cff1-a9d3-4613-88eb-38cf0c0773b5 req-573daaaa-deec-4491-ab73-b7edad41b197 service nova] Creating event network-vif-plugged:6ac5a146-2fb2-4d85-bf90-5543fd4e51e7 for instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 on hv-cinder-82282 Sep 19 11:25:39.558650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-bc70cff1-a9d3-4613-88eb-38cf0c0773b5 req-573daaaa-deec-4491-ab73-b7edad41b197 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053278 Sep 19 11:25:39.559541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 56/113] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:39.763692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:39.764432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:39.770444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.770926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.771386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.772077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.772522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.772938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.784939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:39.787539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:39.795583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.796706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.797414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:39.798668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:39.799952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:39.800690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.030686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:40.042116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3882d850-8ab0-4860-b76a-ad2d398817a2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.282914 Sep 19 11:25:40.042993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:40.043140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 58/114] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:39 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:40.051036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cae2f2d6-7d22-453a-93ac-6c2534821cbb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.271449 Sep 19 11:25:40.051574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 57/115] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:39 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:40.163960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:40.164578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:40.171306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:40.171796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:40.172664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.172916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:40.173381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:40.173789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:40.316771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:40.325538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-63b7c251-ecce-4c21-a140-3a1cb71321ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.165275 Sep 19 11:25:40.326479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 59/116] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:40 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:41.075123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:41.075963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:41.076437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:41.077148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:41.083675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:41.084120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:41.084211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:41.084469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:41.084614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:41.085223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:41.086293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:41.086765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:41.087276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:41.088777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:41.089266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:41.089695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:41.307601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:41.310242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:41.312016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:41.316212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0262a411-3c47-496d-908d-f6621a969256 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.244438 Sep 19 11:25:41.317231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 60/117] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:41 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:41.320102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0ff7ac6d-06c3-4104-b85a-82aacdac9902 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.249805 Sep 19 11:25:41.320667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 58/118] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:41 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:41.348650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:41.349329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:41.355314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:41.355809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:41.356247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:41.356951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:41.357438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:41.357843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:41.501514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:41.509399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f16e2673-f1b9-480e-bf38-045fae78617b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.164574 Sep 19 11:25:41.510577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 61/119] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:41 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:41.574567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-111afabe-2273-4d20-859a-fc5fa79a9e6a req-79fc588d-9341-4fc5-8e40-30ccc4ae8add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f432e6-7d1d-43a6-9073-2603faabd4f7", "name": "network-vif-plugged", "status": "completed", "tag": "0b1fae1c-cd4d-422b-94f6-900878d04a07"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:41.584321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-111afabe-2273-4d20-859a-fc5fa79a9e6a req-79fc588d-9341-4fc5-8e40-30ccc4ae8add service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:41.584839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-111afabe-2273-4d20-859a-fc5fa79a9e6a req-79fc588d-9341-4fc5-8e40-30ccc4ae8add service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:41.585271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-111afabe-2273-4d20-859a-fc5fa79a9e6a req-79fc588d-9341-4fc5-8e40-30ccc4ae8add service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:41.596899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-111afabe-2273-4d20-859a-fc5fa79a9e6a req-79fc588d-9341-4fc5-8e40-30ccc4ae8add service nova] Creating event network-vif-plugged:0b1fae1c-cd4d-422b-94f6-900878d04a07 for instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 on hv-cinder-82282 Sep 19 11:25:41.602110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-111afabe-2273-4d20-859a-fc5fa79a9e6a req-79fc588d-9341-4fc5-8e40-30ccc4ae8add service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031249 Sep 19 11:25:41.602883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 59/120] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:42.341327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:42.342551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:42.346119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:42.346887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:42.353288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.353774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.358059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.358059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.358225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.358420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.358515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.358622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.358708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.358708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.358708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.358708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.732300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:42.746755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:42.748307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-366215b5-bec5-4bab-b747-1dc4999e73fb tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.412008 Sep 19 11:25:42.748940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 62/121] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:42 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:42.757539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-21f19be8-14ea-465e-a1dd-d82beada20f6 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.415887 Sep 19 11:25:42.771222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 60/122] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:42 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:42.771582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:42.771582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:42.771582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.771582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.771889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.771889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:42.772285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:42.772714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:42.912340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:42.920792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3f139b40-6d99-4da1-bb37-6a9617cf61b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.165916 Sep 19 11:25:42.921749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 63/123] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:42 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:43.771709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:43.772414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:43.779021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.779812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.780248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.781945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.781945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.782209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.786356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:43.787039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:43.793273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.793787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.794218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:43.794909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:43.796151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:43.796151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:44.062340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:44.070721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ca9d59d-b136-4e97-929f-b8170bfbc0c7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.289066 Sep 19 11:25:44.071349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 64/124] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:43 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:44.072688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:44.076906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:44.077514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:44.081673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b770504d-0df4-4f0b-acf8-b9303ae5955c tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.313786 Sep 19 11:25:44.082237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 61/125] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:43 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:44.097709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:44.097709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:44.097709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:44.097709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:44.098090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:44.098090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:44.227582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:44.236840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fc2465dd-9952-41ab-973a-a667574a4354 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.164200 Sep 19 11:25:44.239732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 65/126] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:44 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:45.095263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:45.095956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:45.102347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:45.102935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:45.103476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.104297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:45.104836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:45.105334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:45.105765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.106134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:45.114112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:45.114876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:45.115669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.116375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:45.116862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:45.117286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.321539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:45.324625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:45.331282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-88b1c246-3064-47de-b951-8d83fe806738 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.239907 Sep 19 11:25:45.338248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 62/127] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:45 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:45.338412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85e1e194-efeb-475b-8a13-3fcff556a690 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.231195 Sep 19 11:25:45.338412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 66/128] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:45 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:45.342801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:45.343586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:45.350675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:45.351081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:45.351538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.352225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:45.352674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:45.353232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:45.493104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:45.502481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-24ac1b5c-3e65-4118-a80e-784a55a8dc14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.169632 Sep 19 11:25:45.503045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 63/129] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:45 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:46.357166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:46.357789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:46.358425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:46.359552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:46.365609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.366103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.366535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.367246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.367855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.368437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.374042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.374546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.374984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.378260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.378775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.379252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.574345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:46.582229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9675fc03-3392-447b-a128-ca3a47b829bc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.227477 Sep 19 11:25:46.582791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 64/130] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:46 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:46.587219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:46.587891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:46.589036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:46.593931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.594406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.594837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.595544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:46.595988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:46.596401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:46.597956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3901601b-10fd-4f23-b6bb-2b9de16c7526 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.245571 Sep 19 11:25:46.599088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 67/131] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:46 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:46.603689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:46.736088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:46.743844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b9e46dd3-d316-47dc-8fa2-90f3e8bc3a31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.160012 Sep 19 11:25:46.744417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 65/132] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:46 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:47.604784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:47.605388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:47.611428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.612112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.612548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.613239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.613692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.614112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.624733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:47.625342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:47.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.636345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.636345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.823275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:47.830170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:47.835119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-159799ae-6baf-4e48-8f96-7116e78e36e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.234099 Sep 19 11:25:47.835724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 68/133] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:47 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:47.841533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:47.842309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:47.848731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.849210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.849639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.850317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:47.850795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:47.851238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:47.854117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7c9696d8-e05a-4441-b4cb-56e4a4a69dae tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.233272 Sep 19 11:25:47.854712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 66/134] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:47 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:47.983140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:47.991348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d8763336-7a9c-4740-ac8b-ab5ea1685578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.154107 Sep 19 11:25:47.991552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 69/135] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:47 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:48.860993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:48.861710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:48.867839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.868861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.868861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:48.870222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.870743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.871374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:48.878768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:48.879417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:48.887440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.887931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.888355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:48.889544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:48.890142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:48.890707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.104817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:49.108328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:49.118783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-411eb60d-bc88-4ca5-8f37-2630f54b2f12 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.262666 Sep 19 11:25:49.127294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 67/136] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:48 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:49.128959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5f12731f-2aa6-4fe4-bead-b528ff53192f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.255262 Sep 19 11:25:49.138508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-bb1034c7-5be1-4e88-901e-f44c690c46b1 req-3c8ad950-ef6f-4803-9634-4e90a8935499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c2424a-e9d7-4e1c-918a-f7b718b4fd0d", "name": "network-vif-plugged", "status": "completed", "tag": "1e00f0af-d58e-4616-b88f-cf53edaabac1"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:49.143723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 70/137] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:48 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:49.145862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:49.147252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:49.153813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:49.154592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:49.154862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bb1034c7-5be1-4e88-901e-f44c690c46b1 req-3c8ad950-ef6f-4803-9634-4e90a8935499 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:49.155375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bb1034c7-5be1-4e88-901e-f44c690c46b1 req-3c8ad950-ef6f-4803-9634-4e90a8935499 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:49.155708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.155844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-bb1034c7-5be1-4e88-901e-f44c690c46b1 req-3c8ad950-ef6f-4803-9634-4e90a8935499 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.156853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:49.157411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:49.157936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:49.175584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-bb1034c7-5be1-4e88-901e-f44c690c46b1 req-3c8ad950-ef6f-4803-9634-4e90a8935499 service nova] Creating event network-vif-plugged:1e00f0af-d58e-4616-b88f-cf53edaabac1 for instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d on hv-cinder-82282 Sep 19 11:25:49.193559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-bb1034c7-5be1-4e88-901e-f44c690c46b1 req-3c8ad950-ef6f-4803-9634-4e90a8935499 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066573 Sep 19 11:25:49.194514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 68/138] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:25:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:25:49.317126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:49.325261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-88dc1217-c57f-49d1-91f5-28920a8e0964 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.183564 Sep 19 11:25:49.325838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 71/139] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:49 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:50.145093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:50.146906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:50.154947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.155476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.155917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.156630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.157083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.157511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.157782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:50.159196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:50.167063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.167908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.168496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.169363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.169952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.170375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.391677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:50.395270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:50.399599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c81b398c-6025-4e1a-8bfb-54f691922db4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.258581 Sep 19 11:25:50.400188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 69/140] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:50 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:50.405315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:50.406067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:50.407512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-94afce7a-8058-4e94-9f4d-5ec1230f44da tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.255281 Sep 19 11:25:50.408249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 72/141] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:50 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:50.415395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.416075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.416572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.417767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:50.418220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:50.418632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:50.574360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:50.582339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1d49185d-a7db-4d2f-85e3-36b8d966c7af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.181155 Sep 19 11:25:50.583002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 70/142] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:50 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:51.424339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:51.425362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:51.433088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.433371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.433811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.434427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:51.434887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.435156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.435658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.436576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:51.443611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.444114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.444545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.445412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.446049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.446644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.682733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:51.687846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:51.691737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-59230046-3e2f-451b-8587-468a59a3ce00 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.261584 Sep 19 11:25:51.692748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 71/143] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:51 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:51.696316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0310ba04-c6df-408f-a43e-545a6fd5f0c0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.276556 Sep 19 11:25:51.697193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 73/144] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:51 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:51.708697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:51.708697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:51.714241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.714241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.714241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.714241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:51.714782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:51.714782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:51.846655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:51.854723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-04c5a41f-8aaf-4f71-b625-5bbb3c499578 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.160514 Sep 19 11:25:51.855336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 72/145] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:51 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:52.722687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:52.722687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:52.723261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:52.723261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:52.726769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.727374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.727890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.728255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.728725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.728876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.729719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.729837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.730478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.730610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.731001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.731612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.934295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:52.938345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:52.942973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d0e062c7-299d-4407-adf1-a43ef8cbd559 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.227460 Sep 19 11:25:52.955247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 74/146] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:52 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:52.955247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:52.955247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:52.955247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.959931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.959931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.959931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:52.959931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:52.960261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:52.960346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f19da569-592d-44f8-95e5-b470ddb75047 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.241217 Sep 19 11:25:52.960346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 73/147] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:52 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:53.090883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:53.099389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-589d5ed0-b892-4fdd-a26d-d5e82f449cd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.154551 Sep 19 11:25:53.105321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 75/148] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:52 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:53.967287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:53.968472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:53.974302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.974782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.975234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:53.977484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.977484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.977484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:53.983976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:53.984744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:53.991092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.991743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.992639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:53.993348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:53.993810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:53.994239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:54.177668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:54.180651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:54.186071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e4ee534-918f-4151-ae17-b13714b48bd3 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.222828 Sep 19 11:25:54.186557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 74/149] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:53 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:54.191163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2964965c-2452-4e38-9550-3ec86cebb93a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.211031 Sep 19 11:25:54.191163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 76/150] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:53 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:54.191395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:54.191917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:54.199691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:54.208404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:54.209243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:54.210265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:54.210748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:54.211318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:54.340772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:54.348457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-861356c5-762a-4a4b-a219-7bfd3aae8e23 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1321 microversion: 2.1 time: 0.160855 Sep 19 11:25:54.349035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 75/151] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:54 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:55.218773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:55.219409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:55.221140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:55.222021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:55.227281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.229027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.230000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.230697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.231602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.232222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.236118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.251345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.251943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.254622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.255320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.257517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.264381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:55.461272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:55.480692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:55.489626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-41bcd9d2-b5ab-40a0-af00-0ef1de566355 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.281146 Sep 19 11:25:55.493497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d454c0a9-83b0-42b0-8eb5-e89715680359 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.279730 Sep 19 11:25:55.494293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 76/152] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:55 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:55.499348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:55.500013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:55.505485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 77/153] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:55 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:55.506034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.506515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.506950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.507661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.508115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.508540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.656328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:55.664413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e379311-9410-41ff-98cc-029e0d6fd099 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1515 microversion: 2.1 time: 0.168620 Sep 19 11:25:55.664905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 77/154] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:55 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:55.687844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:25:55.690199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:55.696518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.697011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.697449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.698299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:55.698834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:55.699288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:55.764369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lazy-loading 'flavor' on Instance uuid 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:25:56.051339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b0b3ebbb-d53f-4d0f-9059-2695e968c45a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1/action" status: 200 len: 32 microversion: 2.1 time: 0.367485 Sep 19 11:25:56.054368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 78/155] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:25:55 2022] POST /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:25:56.062552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:56.063331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:56.069929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:56.070408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:56.070978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:56.071786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:56.072241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:56.072644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:56.211642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:56.219606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-549a9620-ee34-4e2b-a331-b473abb1f239 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.160968 Sep 19 11:25:56.220178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 78/156] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:56 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:56.512216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:56.513184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:56.517079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:56.517779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:56.519438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:56.519929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:56.520365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:56.521058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:56.521601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:56.522018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:56.525083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:56.525931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:56.526602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:56.527506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:56.528288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:56.528915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:56.759333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:56.767907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-569c9e77-e140-452f-92d7-1fd80064a38f tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.259876 Sep 19 11:25:56.768768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 79/157] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:56 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:56.779155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:56.789960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5da77f2a-7efd-4c4d-b1ec-bfe6c78fdfa3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.277646 Sep 19 11:25:56.790810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 79/158] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:56 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:57.241778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:57.242377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:57.248262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.248733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.249191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.249866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.250319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.250740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.392378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:57.398808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e63178a5-7dbb-42df-ba30-ab9479151bc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.160726 Sep 19 11:25:57.399474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 80/159] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:57 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:57.792155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:57.792790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:57.798932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.799460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.799869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.800543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.800987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.801409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.813809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:57.818709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:57.820874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.821403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.821834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:57.822521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:57.823195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:57.823616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:58.036283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:58.064947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:58.067115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bbf3a745-30d2-4304-aa01-4f2eb9b746b2 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.277731 Sep 19 11:25:58.067115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 80/160] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:57 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:58.075905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9ea948b4-1586-4ddd-acb6-34413e3f9ad7 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.265920 Sep 19 11:25:58.085607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 81/161] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:57 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:58.425653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:58.426565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:58.434909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:58.435474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:58.435915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:58.436627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:58.437084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:58.437733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:58.570826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:58.578840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a8ca8661-0f32-4bd2-ad05-8fe8272b4555 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.157196 Sep 19 11:25:58.579459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 81/162] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:58 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:59.101826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:59.102451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:59.103597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:59.108365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:59.110382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.110887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.111416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.113667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.113667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.113667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.119045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.119809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.120452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.121381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.123005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.123830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.144675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:59.451789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:59.460739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f63a77cf-8bb7-4f64-aa3b-3b15d51e5ee5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1361 microversion: 2.1 time: 0.363323 Sep 19 11:25:59.462121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 82/163] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:59 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1361 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:25:59.466766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:59.479363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9b339f81-8ab3-4e4b-b018-aefc7fc60404 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1314 microversion: 2.1 time: 0.386639 Sep 19 11:25:59.479951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 82/164] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:59 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1314 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:25:59.601990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:25:59.602639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:25:59.604541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=88 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:25:59.609379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.609936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.610382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.611077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:25:59.611571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:25:59.611986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:25:59.756098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:25:59.766432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c935cd36-7788-4d12-bb9c-709984cc5929 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.166984 Sep 19 11:25:59.766950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 83/165] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:25:59 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:00.486112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:00.489080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:00.492868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.493351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.493786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.494472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.494925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.495372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.502626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:00.503390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:00.509712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.510315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.511371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.511736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.512388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.512817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.866919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:00.874353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a202b06-02b3-47f5-bfc1-3a8aa4cc2092 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1546 microversion: 2.1 time: 0.392243 Sep 19 11:26:00.875402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 83/166] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:00 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1546 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:00.880785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:00.883803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:00.885249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:00.906818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.908212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.912543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.912543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.912543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.912543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.920936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d16f73e2-eaf5-4a05-9e55-fb64590914ff tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1501 microversion: 2.1 time: 0.422848 Sep 19 11:26:00.923512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 84/167] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:00 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1501 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:00.931199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:00.935563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:00.940145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.940842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.941290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:00.941994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:00.942455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:00.942878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:01.101385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d1343d04-f49e-4544-801c-a0b2cd03d6e1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.176688 Sep 19 11:26:01.102101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 85/168] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 11:26:00 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-interface => generated 284 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:01.200748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:01.219408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f6cd4604-e454-4dc8-8f37-08469d735303 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.332380 Sep 19 11:26:01.219408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 84/169] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:00 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:02.233318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:02.234555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:02.240644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:02.241124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:02.241552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:02.242238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:02.242682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:02.243099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:02.633326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:02.642495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5dbf00d0-a79e-4e71-83f2-d027d8e59d77 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.413297 Sep 19 11:26:02.655892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 86/170] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:02 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:02.759211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-a53f9a1e-419b-44f2-842b-cd94f49fd78a req-f66ce78f-0ef1-4e57-95b3-d20e2f870a8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01c2424a-e9d7-4e1c-918a-f7b718b4fd0d", "tag": "1e00f0af-d58e-4616-b88f-cf53edaabac1"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:02.769766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-a53f9a1e-419b-44f2-842b-cd94f49fd78a req-f66ce78f-0ef1-4e57-95b3-d20e2f870a8f service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:02.770369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-a53f9a1e-419b-44f2-842b-cd94f49fd78a req-f66ce78f-0ef1-4e57-95b3-d20e2f870a8f service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:02.770917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-a53f9a1e-419b-44f2-842b-cd94f49fd78a req-f66ce78f-0ef1-4e57-95b3-d20e2f870a8f service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:02.783350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-a53f9a1e-419b-44f2-842b-cd94f49fd78a req-f66ce78f-0ef1-4e57-95b3-d20e2f870a8f service nova] Creating event network-changed:1e00f0af-d58e-4616-b88f-cf53edaabac1 for instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d on hv-cinder-82282 Sep 19 11:26:02.788437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-a53f9a1e-419b-44f2-842b-cd94f49fd78a req-f66ce78f-0ef1-4e57-95b3-d20e2f870a8f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032824 Sep 19 11:26:02.789068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 85/171] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:03.669120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:03.669977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:03.683761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:03.684978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:03.687745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:03.688550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:03.689168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:03.690461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:04.017417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "479992d9-a264-4b94-bdb1-578e65172c41"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:04.020006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:04.027279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:04.027860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:04.028306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:04.031319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:04.031319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:04.031319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:04.033023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:04.043347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-273221d1-8ab5-48cc-a318-8c68c4c0bbe3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.380673 Sep 19 11:26:04.044656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 87/172] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:03 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:05.070127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:05.071414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:05.077896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:05.078430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:05.079142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:05.079969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:05.080595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:05.081019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:05.124089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-62b9cce4-537d-48ce-869f-ad74e98146ea tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "POST /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.103621 Sep 19 11:26:05.124089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 86/173] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 11:26:04 2022] POST /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7/os-volume_attachments => generated 194 bytes in 1106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:05.264514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:05.273204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-99590b57-4dc6-4079-8925-3709d443d81c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.207204 Sep 19 11:26:05.273784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 88/174] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:05 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:06.302077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:06.303401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:06.305445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=74 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:06.310868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:06.311665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:06.312324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:06.313342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:06.314108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:06.314700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:06.487217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:06.495138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bd389674-0c9e-442d-8123-8461b960d5c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.198799 Sep 19 11:26:06.495735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 87/175] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:06 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:07.520637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:07.521578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:07.530743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.531268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.531875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.532720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:07.533208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:07.533623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:07.669384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:07.677007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f1f19c19-6ec5-42d5-925d-8557cfaef3fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.162178 Sep 19 11:26:07.677570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 89/176] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:07 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:08.699692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:08.700218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:08.706681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.707151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.707617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:08.709052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:08.709052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:08.709227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:08.890676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:08.898494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-194c1ec3-3c80-45b7-9500-8d1c99ec562d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.202686 Sep 19 11:26:08.899084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 88/177] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:08 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:09.922383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:09.923300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:09.929626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:09.930111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:09.930545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:09.931271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:09.931726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:09.932456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:10.081214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:10.092266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e52c9f6-9ba8-4512-a796-80576418c36d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.174147 Sep 19 11:26:10.093635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 90/178] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:09 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:11.120415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:11.121036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:11.127830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.128320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.128755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.129545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:11.129961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:11.136842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:11.281512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:11.289461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce46638b-4964-4df7-911a-1985da44654a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.172801 Sep 19 11:26:11.289978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 89/179] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:11 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:12.313818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:12.314432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:12.320392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:12.320882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:12.321317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:12.322160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:12.322517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:12.322937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:12.459750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:12.468376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e12def68-fcdf-4c24-9846-113ff8fc2481 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.158490 Sep 19 11:26:12.468943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 91/180] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:12 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:13.492022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:13.492663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:13.499895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:13.500381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:13.500818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:13.501510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:13.501962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:13.502382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:13.665028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:13.673341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-019b8f48-05f9-4a0f-b685-b07e4a5c3700 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.185116 Sep 19 11:26:13.673904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 90/181] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:13 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:13.888078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1665765747", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "networks": [{"uuid": "24e6bf54-6f82-4f40-9ad7-5e683238854a"}]}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:13.956960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] validate_networks() for [('24e6bf54-6f82-4f40-9ad7-5e683238854a', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:26:14.366601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:26:14.367357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:26:14.368019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:26:14.368579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:26:14.368998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:26:14.379204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.379920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.380518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.381295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.381841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.382425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.402328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Getting quotas for project 47fc574b240e4a09bb83d1d2f20558c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:26:14.409475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Getting quotas for user e81d8e2a42f34cc0b4f3ca54eb203f59 and project 47fc574b240e4a09bb83d1d2f20558c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:26:14.420920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:26:14.423286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:26:14.644988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eea6b3d2-8b0e-4632-a2eb-a74d30f92054 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.761539 Sep 19 11:26:14.645633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 92/182] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:26:13 2022] POST /compute/v2.1/servers => generated 380 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:26:14.661648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1733432f-5cc7-4117-876c-d8c059d85fd2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:14.662260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1733432f-5cc7-4117-876c-d8c059d85fd2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:14.696977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:14.697836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:14.704066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.704541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.704970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.705825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:14.706267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:14.706860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:14.716348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1733432f-5cc7-4117-876c-d8c059d85fd2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:14.723400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1733432f-5cc7-4117-876c-d8c059d85fd2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1214 microversion: 2.1 time: 0.066626 Sep 19 11:26:14.724603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 91/183] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:14 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:14.860104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:14.868110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-224aa276-fa99-4ff9-8734-3ed20df85c97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.174925 Sep 19 11:26:14.868696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 93/184] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:14 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:15.748592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-35663556-bbd2-40bd-a54a-8886a7dc5258 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:15.749198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-35663556-bbd2-40bd-a54a-8886a7dc5258 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:15.812245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-35663556-bbd2-40bd-a54a-8886a7dc5258 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:15.819694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-35663556-bbd2-40bd-a54a-8886a7dc5258 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1214 microversion: 2.1 time: 0.075558 Sep 19 11:26:15.831942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 92/185] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:15 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:15.890626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:15.891580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:15.898321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:15.898841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:15.899388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:15.900271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:15.901054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:15.901658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:16.066216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:16.077678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3897e5cf-759f-484f-be84-ffcde1291af2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.190871 Sep 19 11:26:16.078465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 94/186] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:15 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:16.846846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:16.847459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:16.853934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:16.854408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:16.854837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:16.855548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:16.855996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:16.856418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:16.874789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:16.920419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:16.928130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-869edf55-b77a-4784-ae09-340c9215b02f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1266 microversion: 2.1 time: 0.085252 Sep 19 11:26:16.928704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 93/187] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:16 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:17.102151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:17.102861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:17.109872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.110515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.121635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:17.122377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.122854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.123313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:17.256116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:17.264506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-760e41e0-2670-4224-a3b6-dc4b8cc46df4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.166214 Sep 19 11:26:17.265159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 95/188] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:17 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:17.957163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:17.960587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:17.973159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.974455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.975806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:17.977373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:17.978167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:17.978944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:18.099198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:18.119155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aafa21d2-8000-4621-8ca1-cacec001edda tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1272 microversion: 2.1 time: 0.157786 Sep 19 11:26:18.122560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 94/189] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:17 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1272 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:18.287558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:18.288162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:18.294071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:18.294534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:18.294969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:18.295715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:18.296160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:18.296596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:18.462795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:18.482406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d933769c-9069-4bdf-ab23-bd0c50039748 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.198625 Sep 19 11:26:18.485288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 96/190] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:18 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:19.145086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:19.146403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:19.154510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.155285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.156010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.156860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.157461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.158198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.373188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:19.381488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ec7c0f1-165c-49e1-88ea-4db4b4dfa54c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.240138 Sep 19 11:26:19.382068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 95/191] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:19 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:19.406181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-d46a76cf-bc40-4c01-b69a-866b4654352c req-f11c017f-3de6-440c-b6f4-97706a4b31b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "413f0598-7f4c-4e37-a69b-e7dbfde702c9", "tag": "a28875c4-96ab-4727-82e9-da67ec7bbc8b"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:19.424133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-d46a76cf-bc40-4c01-b69a-866b4654352c req-f11c017f-3de6-440c-b6f4-97706a4b31b7 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.424133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-d46a76cf-bc40-4c01-b69a-866b4654352c req-f11c017f-3de6-440c-b6f4-97706a4b31b7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.424133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-d46a76cf-bc40-4c01-b69a-866b4654352c req-f11c017f-3de6-440c-b6f4-97706a4b31b7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.437185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-d46a76cf-bc40-4c01-b69a-866b4654352c req-f11c017f-3de6-440c-b6f4-97706a4b31b7 service nova] Creating event network-changed:a28875c4-96ab-4727-82e9-da67ec7bbc8b for instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 on hv-cinder-82282 Sep 19 11:26:19.442886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-d46a76cf-bc40-4c01-b69a-866b4654352c req-f11c017f-3de6-440c-b6f4-97706a4b31b7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043474 Sep 19 11:26:19.443533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 97/192] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:19.506318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:19.507516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:19.515952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.518973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.518973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.518973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:19.518973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:19.519389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:19.662690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:19.689796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5194982a-95e5-4154-849a-c0e8751a527b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.182649 Sep 19 11:26:19.689796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 96/193] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:19 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:20.409450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:20.410175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:20.417039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.418267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.418704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:20.419426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.419947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.420626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:20.552210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:20.559952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a64de8c0-d185-47a5-a0e3-47e0f4faa1d9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.155170 Sep 19 11:26:20.560525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 98/194] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:20 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:20.708249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:20.708857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:20.715660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.716184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.716623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:20.717319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:20.717778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:20.718203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:20.865985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:20.874673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c874419b-dffd-4496-8b47-f3f3acc582b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.170321 Sep 19 11:26:20.875495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 97/195] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:20 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:21.582669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:21.583302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:21.590208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:21.592784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:21.592784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:21.592784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:21.592784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:21.593171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:21.734586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:21.746332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bed2cc70-25f3-483c-86ad-41da70c4d72c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.166858 Sep 19 11:26:21.746958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 99/196] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:21 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:21.899296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:21.900357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:21.910411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:21.910411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:21.910411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:21.910411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:21.911128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:21.911128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:22.057479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:22.065417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d7b7d362-67e5-46bc-88cd-50f33f24cdc2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.170357 Sep 19 11:26:22.066349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 98/197] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:21 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:22.768759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:22.769720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:22.776957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:22.777450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:22.777887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:22.778589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:22.779053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:22.779559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:22.912044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:22.915701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:22.921732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c8432609-b900-407a-ab21-df7f0b49152f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.156748 Sep 19 11:26:22.922583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 100/198] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:22 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:23.089814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:23.090742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:23.104170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.105629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.109993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:23.110765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.111340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.111784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:23.259441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:23.267649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ccd8a13d-2557-4a3f-badd-b2fe3c12f8ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.182411 Sep 19 11:26:23.268772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 99/199] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:23 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:23.946135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:23.946766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:23.953412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.953887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.954311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:23.954989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:23.955477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:23.955893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:24.270927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:24.278925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07e0389b-d355-4826-871d-5d9b3c0ab1f3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.336898 Sep 19 11:26:24.279542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 101/200] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:23 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:24.291468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:24.296822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:24.298551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:24.299040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:24.299530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:24.300633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:24.300748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:24.301091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:24.438678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:24.446896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-355bddd5-c8e4-4364-a2bb-496b3ee11edf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.159024 Sep 19 11:26:24.447199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 100/201] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:24 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:25.301809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:25.302409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:25.304278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:25.305011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:25.309628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.310102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.310573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.311277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.311725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.313118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.444141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:25.452306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-595e9871-3cf1-451a-919d-fde18f4290a3 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.154345 Sep 19 11:26:25.452878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 102/202] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:25 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:25.470713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:25.471366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:25.477917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.485035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.485035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.485035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:25.485035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:25.485906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:25.611648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:25.619439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5eb48533-8b56-4237-9195-e2f9e225b801 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.152553 Sep 19 11:26:25.620010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 101/203] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:25 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:26.476172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:26.476896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:26.483938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.484322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.484761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:26.485461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.485919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.486341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:26.624175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:26.632226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f3c1e803-2f13-44b9-9e9f-9dfff31b44b1 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.159867 Sep 19 11:26:26.632800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 103/204] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:26 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:26.641806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:26.642418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:26.645845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:26.649883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.650380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.650819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:26.651555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:26.652566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:26.652973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:26.805476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:26.814190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f529bb54-b09d-4237-9df9-e49b880664af tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.176183 Sep 19 11:26:26.815201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 102/205] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:26 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:27.656511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:27.657258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:27.663356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:27.663844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:27.664277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:27.664951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:27.665397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:27.665810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:27.835560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:27.841027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:27.842180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:27.845116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-abce5bb5-1166-4732-a6b7-76f2951922cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.192462 Sep 19 11:26:27.846447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 104/206] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:27 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:27.850404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:27.850897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:27.851375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:27.852077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:27.852639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:27.853089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:28.059417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:28.070479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b674f18b-b01d-4152-8ef0-5017ac141993 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.235979 Sep 19 11:26:28.072803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 103/207] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:27 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:28.869972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:28.870520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:28.877267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:28.877957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:28.878422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:28.879113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:28.879595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:28.880021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.021526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:29.029344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3e109afc-a384-4120-b5bb-2248cf55347b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.163384 Sep 19 11:26:29.029902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 105/208] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:28 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:29.037239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:29.037791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:29.044613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.045976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.045976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.046216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.046668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.047119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.072281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:26:29.107493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:29.108638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:29.115461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.116735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.117400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.119429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.120069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.121272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.279433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:29.287314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e2ed1c1a-e6a0-494c-9173-c00005d0e414 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1521 microversion: 2.1 time: 0.188503 Sep 19 11:26:29.288187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 106/209] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:29 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:29.606663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3cc491d7-9cdc-400b-9910-5fa9dff29eaf tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "DELETE /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 204 len: 0 microversion: 2.1 time: 0.572897 Sep 19 11:26:29.607390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 104/210] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:26:29 2022] DELETE /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 11:26:29.615642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:29.616507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:29.622499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.622988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.623468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.624170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:29.624620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:29.625049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:29.757587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:29.768321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-117921b0-12d0-43e6-8aec-ff1961496ff4 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1553 microversion: 2.1 time: 0.156213 Sep 19 11:26:29.787657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 107/211] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:29 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1553 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:30.052625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:30.053312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:30.060098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.060575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.061004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.061691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.062142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.062565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.231538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.239373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1d6c740-90fd-44e5-85e7-bcf065c7209e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.190835 Sep 19 11:26:30.239938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 105/212] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:30 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:30.312046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:30.312670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:30.320133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.320634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.321081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.321781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.322319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.322746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.460910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.469879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa28effb-abdd-441b-a54e-52e915083f05 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1501 microversion: 2.1 time: 0.162747 Sep 19 11:26:30.470384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 108/213] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:30 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1501 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:30.492106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:30.492710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:30.499577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.500071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.500510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.501211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.501666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.502263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.659955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.669426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bed90fcb-6e02-433f-9938-e17101dc2728 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1515 microversion: 2.1 time: 0.181265 Sep 19 11:26:30.670382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 106/214] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:30 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1515 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:30.804320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:30.804320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:30.805879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:30.810427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.810925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.811396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.815252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:30.815994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:30.816436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:30.980765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:30.993867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ca7f2217-6a43-4f0d-a35d-d2c9aff84042 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1553 microversion: 2.1 time: 0.194549 Sep 19 11:26:30.993867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 109/215] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:30 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1553 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:31.275814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:31.275814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:31.299548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:31.300421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:31.303475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:31.308559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:31.309475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:31.310320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:31.603459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:31.633818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce64bb95-7888-4829-a0e4-2af414626cd8 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.374587 Sep 19 11:26:31.643985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 107/216] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:31 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:32.017475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:32.018167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:32.025376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.026184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.026856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.027872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.028518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.029284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.195449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:32.206249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e5cff0e7-9366-4123-a914-a9994a831b50 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1553 microversion: 2.1 time: 0.194583 Sep 19 11:26:32.206833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 110/217] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:32 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:32.683887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:32.683887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:32.696016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:32.699036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:32.702330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.706634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.707191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.708002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.710246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.710969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.711059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.711832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.717148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.718539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:32.721406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:32.721406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:32.739719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:32.792343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lazy-loading 'flavor' on Instance uuid 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:26:32.940146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:32.950880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-28d96c7d-2c9f-4701-8650-a816ee46acba tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.273891 Sep 19 11:26:32.969482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 108/218] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:32 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:33.230672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:33.231608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:33.238003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.238494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.238921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.239634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.240231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.240654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.303866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6df41048-f622-4ece-983c-f22770547be8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45/action" status: 200 len: 32 microversion: 2.1 time: 0.612369 Sep 19 11:26:33.304563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 111/219] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:26:32 2022] POST /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45/action => generated 32 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:26:33.314207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-1294893a-6be6-4107-9d2f-37d7c4b8178d req-57b577dc-a0d9-45db-a609-2f7291170eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413f0598-7f4c-4e37-a69b-e7dbfde702c9", "name": "network-vif-plugged", "status": "completed", "tag": "a28875c4-96ab-4727-82e9-da67ec7bbc8b"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:33.338024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-1294893a-6be6-4107-9d2f-37d7c4b8178d req-57b577dc-a0d9-45db-a609-2f7291170eab service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.343333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-1294893a-6be6-4107-9d2f-37d7c4b8178d req-57b577dc-a0d9-45db-a609-2f7291170eab service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.345082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-1294893a-6be6-4107-9d2f-37d7c4b8178d req-57b577dc-a0d9-45db-a609-2f7291170eab service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.367135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-1294893a-6be6-4107-9d2f-37d7c4b8178d req-57b577dc-a0d9-45db-a609-2f7291170eab service nova] Creating event network-vif-plugged:a28875c4-96ab-4727-82e9-da67ec7bbc8b for instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 on hv-cinder-82282 Sep 19 11:26:33.380006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-1294893a-6be6-4107-9d2f-37d7c4b8178d req-57b577dc-a0d9-45db-a609-2f7291170eab service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073781 Sep 19 11:26:33.381508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 112/220] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:33.383159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:33.392997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:33.393933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:33.403787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.404649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.406100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.410294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.411311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.412061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.428833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-205e07a1-f006-4c64-8cc1-2816901f7249 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1511 microversion: 2.1 time: 0.180636 Sep 19 11:26:33.444490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 109/221] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:33 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1511 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:33.588462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-adb4d381-5892-4f14-b555-6a8cf8c0d59d req-9dd425f4-b012-457c-a5f3-8f2a45a125d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33f432e6-7d1d-43a6-9073-2603faabd4f7", "name": "network-vif-deleted", "tag": "0b1fae1c-cd4d-422b-94f6-900878d04a07"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:33.601367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-adb4d381-5892-4f14-b555-6a8cf8c0d59d req-9dd425f4-b012-457c-a5f3-8f2a45a125d6 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.602465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-adb4d381-5892-4f14-b555-6a8cf8c0d59d req-9dd425f4-b012-457c-a5f3-8f2a45a125d6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.603062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-adb4d381-5892-4f14-b555-6a8cf8c0d59d req-9dd425f4-b012-457c-a5f3-8f2a45a125d6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:33.618197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-adb4d381-5892-4f14-b555-6a8cf8c0d59d req-9dd425f4-b012-457c-a5f3-8f2a45a125d6 service nova] Creating event network-vif-deleted:0b1fae1c-cd4d-422b-94f6-900878d04a07 for instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 on hv-cinder-82282 Sep 19 11:26:33.624862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-adb4d381-5892-4f14-b555-6a8cf8c0d59d req-9dd425f4-b012-457c-a5f3-8f2a45a125d6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040183 Sep 19 11:26:33.625756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 110/222] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:26:33.887150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:33.897960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-df2b98e2-1cc0-45c9-8a98-5729f65c572c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.515311 Sep 19 11:26:33.900957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 113/223] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:33 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:33.979302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:33.984297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:33.997429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:33.998402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:33.999367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.000086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.004956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.004956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.365847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:34.385612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-abd70b8c-de91-4845-a6ee-c933681f8a5f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.412794 Sep 19 11:26:34.391882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 111/224] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:33 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:34.458501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:34.459380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:34.466959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.467694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.468134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.468954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.469546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.470137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.504349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.504857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.505459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.505935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lazy-loading 'fault' on Instance uuid 33f432e6-7d1d-43a6-9073-2603faabd4f7 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:26:34.576761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:34.585123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4daf5af1-012c-4119-9671-2d09e5c633df tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1350 microversion: 2.1 time: 0.130501 Sep 19 11:26:34.586103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 114/225] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:34 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:34.924843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:34.929076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:34.933607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.933994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.934598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:34.935646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:34.936102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:34.936527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.178713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:35.196376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a397b83-62b5-4a61-bc87-ac50765a2cea tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.275449 Sep 19 11:26:35.196970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 112/226] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:34 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:35.413562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:35.414162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:35.422586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.422586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.422586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.422586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.423016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.423528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.594010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:35.597587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:35.602158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07752ae2-cfaf-4e41-8562-537db091eb89 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1314 microversion: 2.1 time: 0.192434 Sep 19 11:26:35.602776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 115/227] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:35 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:35.615686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:35.616353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:35.624272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.624272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.624681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.625379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.625893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.626326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.659203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:35.659685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:35.660135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:35.660575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lazy-loading 'fault' on Instance uuid 33f432e6-7d1d-43a6-9073-2603faabd4f7 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:26:35.710904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eec3ef0842b948deb7ecc46f7c56dd04', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '089d6ade5a3d4e48868bc6cc190c6251', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:35.719784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fd017164-472d-4f87-99bc-730f78513457 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 200 len: 1350 microversion: 2.1 time: 0.108205 Sep 19 11:26:35.726647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 113/228] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:35 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 1350 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:36.220149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:36.220998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:36.227891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:36.228378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:36.228810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:36.229507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:36.230150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:36.230573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:36.410678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:36.418318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a310fb9-e656-4a79-8f1b-f8d6bb32c8b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.202393 Sep 19 11:26:36.418894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 116/229] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:36 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:36.625496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:36.626170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:36.629668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:36.633784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:36.636642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:36.636642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:36.636642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:36.636642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:36.637043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:36.749308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:36.750397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:36.756514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:36.757317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:36.760291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:36.760291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:36.760291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:36.760291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:36.774650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] HTTP exception thrown: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:36.791473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Request method failure captured: Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 HTTP/1.1 Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGRYerisAnbEnXq4d8E4tlXD2uft1SlVH-XqnSdLcJwetijBe4P-3nNE4VVBnhbxCmJjU2SgjYcTMGGxFw_3JTZPwHtC5sVsoVNINm0EcUeBJUCQjMhYs6e1t3siLff2uJvhupA6tHQ2IxraXM8urXVrxURhptJZdHtM-QYwOzp1Sc Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:26:36.794765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: eec3ef0842b948deb7ecc46f7c56dd04 Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:36.796446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '33f432e6-7d1d-43a6-9073-2603faabd4f7'} Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:26:36.797461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:36.798917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:36.800223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Returning 404 to user: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:26:36.801146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-590015e1-f126-4700-937b-5e989821313d tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 404 len: 111 microversion: 2.1 time: 0.057916 Sep 19 11:26:36.801718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 117/230] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:36 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 11:26:36.806427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-59aa2378-d987-41cf-a640-aac98fa8d7cb tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1497 microversion: 2.1 time: 0.184792 Sep 19 11:26:36.807369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 114/231] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:36 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:37.442036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:37.442641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:37.449562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:37.450036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:37.450469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:37.451146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:37.451618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:37.452071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:37.591369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:37.598919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f50d04c9-1059-4036-aa68-6737980b0477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.161406 Sep 19 11:26:37.599519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 118/232] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:37 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:37.643676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:37.643676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:37.649196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:37.649677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:37.650177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:37.650905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:37.651393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:37.652392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:37.667604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] HTTP exception thrown: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Request method failure captured: Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7/os-volume_attachments HTTP/1.1 Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGRYerisAnbEnXq4d8E4tlXD2uft1SlVH-XqnSdLcJwetijBe4P-3nNE4VVBnhbxCmJjU2SgjYcTMGGxFw_3JTZPwHtC5sVsoVNINm0EcUeBJUCQjMhYs6e1t3siLff2uJvhupA6tHQ2IxraXM8urXVrxURhptJZdHtM-QYwOzp1Sc Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:26:37.671655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: eec3ef0842b948deb7ecc46f7c56dd04 Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:37.678277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '33f432e6-7d1d-43a6-9073-2603faabd4f7'} Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:26:37.679090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:37.680489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:37.681827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Returning 404 to user: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:26:37.681827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f19a0c0b-79d9-4e76-8965-38c541faeb97 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038028 Sep 19 11:26:37.681827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 115/233] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:26:37 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7/os-volume_attachments => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:26:38.625969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:38.626621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:38.634122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:38.634612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:38.635049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:38.635783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:38.636819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:38.637522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:38.769186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:38.781029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3f3fe2d6-99b3-49c2-9795-767865d4f96e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.155424 Sep 19 11:26:38.781029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 119/234] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:38 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:39.247149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:39.248335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:39.261321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.262013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.263205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.264237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.264953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.265370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.293840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:26:39.708285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9c37a7c4-b9ab-4fa5-8c0b-79dea8c80148 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "DELETE /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 204 len: 0 microversion: 2.1 time: 0.464836 Sep 19 11:26:39.708876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 116/235] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:26:39 2022] DELETE /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:26:39.718221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:39.718838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:39.724994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.725480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.725920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.726614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.727070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.727523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.800895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:39.801596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:39.807850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.808618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.809017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.809889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:39.810360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:39.812450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:39.934500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:39.942724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-41bc7827-1f2e-4831-bdb1-d702ac17411c tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1503 microversion: 2.1 time: 0.229403 Sep 19 11:26:39.955720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 120/236] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:39 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1503 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:40.000514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:40.009054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-73a33332-bd7b-49eb-96c0-10f8fdf64698 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.212291 Sep 19 11:26:40.009054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 117/237] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:39 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:40.478474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:40.478998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:40.484982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:40.485462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:40.485895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:40.486579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:40.487027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:40.487501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:40.501676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] HTTP exception thrown: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Request method failure captured: Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 HTTP/1.1 Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGRYerisAnbEnXq4d8E4tlXD2uft1SlVH-XqnSdLcJwetijBe4P-3nNE4VVBnhbxCmJjU2SgjYcTMGGxFw_3JTZPwHtC5sVsoVNINm0EcUeBJUCQjMhYs6e1t3siLff2uJvhupA6tHQ2IxraXM8urXVrxURhptJZdHtM-QYwOzp1Sc Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:26:40.503315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: eec3ef0842b948deb7ecc46f7c56dd04 Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.504747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '33f432e6-7d1d-43a6-9073-2603faabd4f7'} Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:26:40.505512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.506821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.512164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Returning 404 to user: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:26:40.512164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f4cb81e4-f0a3-4c9d-9ef5-a8409c074be6 tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "DELETE /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 404 len: 111 microversion: 2.1 time: 0.030145 Sep 19 11:26:40.512164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 121/238] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:26:40 2022] DELETE /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:26:40.513995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:40.514558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] [instance: 33f432e6-7d1d-43a6-9073-2603faabd4f7] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:40.521452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:40.521943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:40.522440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:40.523216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:40.523678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:40.524106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:40.538411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] HTTP exception thrown: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Request method failure captured: Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 HTTP/1.1 Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGRYerisAnbEnXq4d8E4tlXD2uft1SlVH-XqnSdLcJwetijBe4P-3nNE4VVBnhbxCmJjU2SgjYcTMGGxFw_3JTZPwHtC5sVsoVNINm0EcUeBJUCQjMhYs6e1t3siLff2uJvhupA6tHQ2IxraXM8urXVrxURhptJZdHtM-QYwOzp1Sc Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:26:40.540776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/089d6ade5a3d4e48868bc6cc190c6251"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 089d6ade5a3d4e48868bc6cc190c6251 Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-DeleteServersTestJSON-139829806 Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: eec3ef0842b948deb7ecc46f7c56dd04 Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-DeleteServersTestJSON-139829806-project Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.542252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '33f432e6-7d1d-43a6-9073-2603faabd4f7'} Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:26:40.543049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. Sep 19 11:26:40.544458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:26:40.545525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] Returning 404 to user: Instance 33f432e6-7d1d-43a6-9073-2603faabd4f7 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:26:40.545525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-54c2a182-6597-4369-ac96-124e3dd92fee tempest-DeleteServersTestJSON-139829806 tempest-DeleteServersTestJSON-139829806-project] 10.222.0.78 "GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7" status: 404 len: 111 microversion: 2.1 time: 0.032687 Sep 19 11:26:40.545525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 118/239] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:40 2022] GET /compute/v2.1/servers/33f432e6-7d1d-43a6-9073-2603faabd4f7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:26:40.966663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:40.967302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:40.973829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:40.974655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:40.975199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:40.976007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:40.976729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:40.977207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:41.033137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:41.033804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:41.041245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:41.042137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:41.042780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:41.043720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:41.044378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:41.045012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:41.193995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:41.206749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f0a2cb6f-cf8a-459d-9ea3-e690022ea26b tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1503 microversion: 2.1 time: 0.244036 Sep 19 11:26:41.221180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 122/240] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:40 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1503 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:41.225676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:41.230638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c2cc95c8-c82f-421a-870c-eaf7292a4edc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.201500 Sep 19 11:26:41.232427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 119/241] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:41 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:42.233344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:42.233950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:42.239993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:42.240476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:42.240907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:42.241592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:42.242036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:42.242452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:42.255670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:42.256281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:42.263821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:42.264311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:42.264741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:42.265611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:42.266058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:42.266710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:42.519107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:42.527107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:42.529255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dd07cbf9-8a7a-4ca3-a167-e40f209bcad4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.277456 Sep 19 11:26:42.529834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 120/242] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:42 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:42.537421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c7b96a3c-27cf-4588-85c9-abe87f824543 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1503 microversion: 2.1 time: 0.307904 Sep 19 11:26:42.538656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 123/243] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:42 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1503 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:43.554685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:43.559583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:43.567445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:43.569827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:43.584696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:43.585399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:43.586075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:43.586735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:43.587392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:43.594011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:43.594379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:43.594379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:43.594379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:43.594625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:43.594625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:43.594801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:44.218353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:44.230819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-41a40a6f-f80e-4980-b08d-73f9efb3b1a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.681833 Sep 19 11:26:44.231758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 121/244] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:43 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:44.248077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:44.248077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-135e5391-916e-4c52-8448-fc0a2da8caef tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1503 microversion: 2.1 time: 0.683098 Sep 19 11:26:44.248077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 124/245] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:43 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1503 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:44.918974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-836ef7e7-372d-4028-b19a-9911b37ab9a5 req-3a55b320-4a09-44c5-a446-52faa3f0f35f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "413f0598-7f4c-4e37-a69b-e7dbfde702c9", "name": "network-vif-deleted", "tag": "a28875c4-96ab-4727-82e9-da67ec7bbc8b"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:44.950049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-836ef7e7-372d-4028-b19a-9911b37ab9a5 req-3a55b320-4a09-44c5-a446-52faa3f0f35f service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:44.950759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-836ef7e7-372d-4028-b19a-9911b37ab9a5 req-3a55b320-4a09-44c5-a446-52faa3f0f35f service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:44.951387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-836ef7e7-372d-4028-b19a-9911b37ab9a5 req-3a55b320-4a09-44c5-a446-52faa3f0f35f service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:44.976099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-836ef7e7-372d-4028-b19a-9911b37ab9a5 req-3a55b320-4a09-44c5-a446-52faa3f0f35f service nova] Creating event network-vif-deleted:a28875c4-96ab-4727-82e9-da67ec7bbc8b for instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 on hv-cinder-82282 Sep 19 11:26:44.984172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-836ef7e7-372d-4028-b19a-9911b37ab9a5 req-3a55b320-4a09-44c5-a446-52faa3f0f35f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068861 Sep 19 11:26:44.985080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 125/246] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:45.257703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:45.259323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:45.272317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:45.273343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:45.286616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:45.287668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:45.288579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:45.289254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:45.289904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:45.290585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:45.292323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:45.292686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:45.293297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:45.293723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:45.299411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:45.299411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:45.425200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:45.434476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fcb8e7d3-f9e9-42de-8382-0d3eb961d952 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1299 microversion: 2.1 time: 0.169924 Sep 19 11:26:45.436251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 126/247] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:45 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1299 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:45.545696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:45.570932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9acb2ce2-bbcb-4371-928b-1834bdc44891 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.317090 Sep 19 11:26:45.572106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 122/248] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:45 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:46.463265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:46.467567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:46.491499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:46.492739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:46.493848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:46.496321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:46.497729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:46.499643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:46.593352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:46.593850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:46.596128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:46.602843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:46.603502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:46.609462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lazy-loading 'fault' on Instance uuid 413f0598-7f4c-4e37-a69b-e7dbfde702c9 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:26:46.620591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:46.625933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:46.626669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:46.627679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:46.628297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:46.628880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:46.675522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:46.685674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a930d33-fa73-47a5-8a02-6f5efcfb72c5 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 200 len: 1304 microversion: 2.1 time: 0.227519 Sep 19 11:26:46.689159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 127/249] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:46 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 1304 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:46.868794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:46.882844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aaacd1cf-69e6-49a5-8c54-929823ae5bcd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.281476 Sep 19 11:26:46.882844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 123/250] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:46 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:47.719359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:47.719967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 413f0598-7f4c-4e37-a69b-e7dbfde702c9] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:47.725858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:47.726341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:47.726772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:47.727553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:47.728003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:47.728453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:47.743344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] HTTP exception thrown: Instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 could not be found. Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Request method failure captured: Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 HTTP/1.1 Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFHSZKOMlGpsksrWP77JgIZrzJSnHBATjCTOqjz7NoE7ZDxoxhEJlaZl3TgSe2a2Y6D1P2NZ8N-szWb3FhXm8cZUJAv3C_sfcc01BxK0D1gwGTvgizQFPDMKr54m8aPpGY5RhVuIONlKHy6vKO-GeN6L-ynInb7Vd7F9SvEnX-2En8o Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 47fc574b240e4a09bb83d1d2f20558c4 Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesActionsTest-400684052 Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:26:47.745500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesActionsTest-400684052 Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 47fc574b240e4a09bb83d1d2f20558c4 Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesActionsTest-400684052 Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesActionsTest-400684052-project Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: e81d8e2a42f34cc0b4f3ca54eb203f59 Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesActionsTest-400684052-project Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 could not be found. Sep 19 11:26:47.748931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '413f0598-7f4c-4e37-a69b-e7dbfde702c9'} Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 could not be found. Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:26:47.750195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 could not be found. Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 could not be found. Sep 19 11:26:47.751532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:47.752752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Returning 404 to user: Instance 413f0598-7f4c-4e37-a69b-e7dbfde702c9 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:26:47.752752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0b454b9e-9be8-46ff-b865-30d8d31e2bb2 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9" status: 404 len: 111 microversion: 2.1 time: 0.031667 Sep 19 11:26:47.753448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 128/251] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:47 2022] GET /compute/v2.1/servers/413f0598-7f4c-4e37-a69b-e7dbfde702c9 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:26:47.908735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:47.909635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:47.910494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-635016647", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "networks": [{"uuid": "24e6bf54-6f82-4f40-9ad7-5e683238854a"}]}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:47.920412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:47.920888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:47.921330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:47.926126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:47.927119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:47.927800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:48.007687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] validate_networks() for [('24e6bf54-6f82-4f40-9ad7-5e683238854a', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:26:48.275792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:48.286995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-55421036-24fa-4919-941b-07fa28d0f3c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.382563 Sep 19 11:26:48.290375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 129/252] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:47 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:48.615050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:26:48.616383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:26:48.616901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:26:48.617357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:26:48.617767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:26:48.627926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:48.628654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:48.629279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:48.630226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:48.631030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:48.632378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:48.702526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Getting quotas for project 47fc574b240e4a09bb83d1d2f20558c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:26:48.713142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Getting quotas for user e81d8e2a42f34cc0b4f3ca54eb203f59 and project 47fc574b240e4a09bb83d1d2f20558c4. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:26:48.729577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:26:48.732724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:26:48.964853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe0c1e8e-34b7-4ffe-8a99-15bab02e5806 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.061753 Sep 19 11:26:48.965843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 124/253] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:26:47 2022] POST /compute/v2.1/servers => generated 380 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:26:48.976895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bbc714a4-c57a-4ed8-8f1b-df14727d773f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:48.977510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bbc714a4-c57a-4ed8-8f1b-df14727d773f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:49.051285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bbc714a4-c57a-4ed8-8f1b-df14727d773f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:49.064019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bbc714a4-c57a-4ed8-8f1b-df14727d773f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1213 microversion: 2.1 time: 0.090973 Sep 19 11:26:49.067500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 130/254] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:48 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:49.316916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:49.317795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:49.327692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:49.333354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:49.333354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:49.333354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:49.333354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:49.334038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:49.565123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:49.573933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:49.579370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3b0a7161-2bbc-4fd6-83e8-1429390e3100 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.266768 Sep 19 11:26:49.581723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 125/255] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:49 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:50.087403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fef97bd3-6493-4825-ac09-c4f5ee7d7f2e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:50.089495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fef97bd3-6493-4825-ac09-c4f5ee7d7f2e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:50.208253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fef97bd3-6493-4825-ac09-c4f5ee7d7f2e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:50.223386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fef97bd3-6493-4825-ac09-c4f5ee7d7f2e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1213 microversion: 2.1 time: 0.136326 Sep 19 11:26:50.228796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 131/256] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:50 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1213 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:50.606321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:50.607017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:50.639299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:50.639806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:50.642570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:50.643423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:50.643907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:50.644414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:50.893559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:50.906428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-175d5daf-9aeb-46ba-96ad-d9860c96f18f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.305651 Sep 19 11:26:50.920196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 126/257] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:50 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:51.252355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:51.252955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:51.259228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:51.259833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:51.260279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:51.260981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:51.261434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:51.261857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:51.324424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:51.332166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-98f16465-e9cf-483a-9df6-a79f4f756864 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1265 microversion: 2.1 time: 0.083581 Sep 19 11:26:51.332735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 132/258] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:51 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1265 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:51.934673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:51.936619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:51.945675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:51.946923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:51.947461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:51.949574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:51.949709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:51.950154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:52.221903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:52.234116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c76785f9-b022-47f2-84d0-7c03df3a7acc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.303593 Sep 19 11:26:52.235823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 127/259] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:51 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:52.356961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:52.358303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:52.396436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:52.402544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:52.402544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:52.402544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:52.402544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:52.402928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:52.621854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:52.637838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-78910c3f-cc80-42ac-b29c-7a4572a7ea54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1265 microversion: 2.1 time: 0.285684 Sep 19 11:26:52.640889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 133/260] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:52 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1265 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:53.267453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:53.268401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:53.284834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:53.285383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:53.286722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:53.288640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:53.289126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:53.296483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:53.668902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:53.669510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:53.688171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:53.688671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:53.689102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:53.689840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:53.693276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:53.693816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:53.734816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:53.745779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-63bbfca6-f3f3-4abb-99eb-b705af33be85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.482474 Sep 19 11:26:53.763242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 128/261] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:53 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:53.996989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:54.014226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e33e4f55-eef7-49d9-969f-8a7981151907 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1273 microversion: 2.1 time: 0.348439 Sep 19 11:26:54.018279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 134/262] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:53 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1273 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:54.769932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:54.770716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:54.788416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:54.796763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:54.808135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:54.811265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:54.818666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:54.837735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:55.045865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:55.046508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:55.062567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:55.063085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:55.065220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:55.066120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:55.076879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:55.080062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:55.157311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:55.172621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ecb603f3-b504-4195-9540-7ebb8a4bb913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.407940 Sep 19 11:26:55.183682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 129/263] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:54 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:26:55.206217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:55.214722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9541f48e-d77a-4475-866c-b14eb882c5ec tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1271 microversion: 2.1 time: 0.174806 Sep 19 11:26:55.215549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 135/264] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:55 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:56.197424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:56.198657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:56.215259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.215770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.216898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.220356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.220356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.220356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.246453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:56.246453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:56.255785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.258738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.259485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.261937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.262410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.272404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.852666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:56.858308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:56.875289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-39510012-f16b-4ac6-9a22-c16c99b44cb9 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1313 microversion: 2.1 time: 0.637924 Sep 19 11:26:56.877087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:56.877593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 136/265] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:56 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1313 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:56.891672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7d4f923a-7aa4-4508-b851-706002cddb76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1501 microversion: 2.1 time: 0.691805 Sep 19 11:26:56.893504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 130/266] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:56 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1501 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:56.920255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fb222bd8-1081-4d22-90a8-b2ef2de0b8c7"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:56.922992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:56.940191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.942033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.944545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.948942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:56.952160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:56.952750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:56.999881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] HTTP exception thrown: Cannot 'attach_volume' instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 while it is in vm_state rescued Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Request method failure captured: Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: POST /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45/os-volume_attachments HTTP/1.1 Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 74 Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGNVNYktEzfhUQJvHMqhHDK5885Dq_w4mmZ-Ru1g2xuVoENu2t7CE6A8PssN2VKCsc7rqJMKN6hgjiCIzRV8wuFmlhnNe5PCcyISBHYGqapoAGFwwRZ-rXc1X0qoxG3kNafW7daV6Lcpq_b7u6a-msfeZS8KQ9cr3HEUFgpCHebR-M Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:26:57.004550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: d6fee905418f4d879da460b6758d4f23 Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {"volumeAttachment": {"volumeId": "fb222bd8-1081-4d22-90a8-b2ef2de0b8c7"}} Sep 19 11:26:57.006118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Cannot 'attach_volume' instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 while it is in vm_state rescued Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'server_id': '844fd60f-68da-4b43-a8d2-fae5e0a6cf45', 'body': {'volumeAttachment': {'volumeId': 'fb222bd8-1081-4d22-90a8-b2ef2de0b8c7'}}} Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:26:57.007002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 while it is in vm_state rescued Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:26:57.008658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:26:57.010551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:26:57.010551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:26:57.010551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 while it is in vm_state rescued Sep 19 11:26:57.010551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:26:57.012404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Returning 409 to user: Cannot 'attach_volume' instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 while it is in vm_state rescued {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:26:57.013845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bf428ae1-b77f-482e-ad9b-aab312ca4926 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.099323 Sep 19 11:26:57.016805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 137/267] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 11:26:56 2022] POST /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45/os-volume_attachments => generated 152 bytes in 103 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:26:57.025308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:57.026011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:57.032411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.033033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.033733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.034677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.035516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.036151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.233403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-c02b2b0c-2e43-419d-8dd3-86f4d86de516 req-cae68238-64c5-409f-9007-72069cdc0422 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2cffff86-6639-4581-81ea-bf21a264ad10", "tag": "3d3232b3-ccde-4d00-843e-c4b54b1b1d82"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:26:57.272016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c02b2b0c-2e43-419d-8dd3-86f4d86de516 req-cae68238-64c5-409f-9007-72069cdc0422 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.275233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c02b2b0c-2e43-419d-8dd3-86f4d86de516 req-cae68238-64c5-409f-9007-72069cdc0422 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.276229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c02b2b0c-2e43-419d-8dd3-86f4d86de516 req-cae68238-64c5-409f-9007-72069cdc0422 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.298633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-c02b2b0c-2e43-419d-8dd3-86f4d86de516 req-cae68238-64c5-409f-9007-72069cdc0422 service nova] Creating event network-changed:3d3232b3-ccde-4d00-843e-c4b54b1b1d82 for instance 2cffff86-6639-4581-81ea-bf21a264ad10 on hv-cinder-82282 Sep 19 11:26:57.313792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-c02b2b0c-2e43-419d-8dd3-86f4d86de516 req-cae68238-64c5-409f-9007-72069cdc0422 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085895 Sep 19 11:26:57.316326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 138/268] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:26:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:57.559925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2959566f-4c78-4ba2-b2cb-f0a8c7e22477 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45/action" status: 202 len: 0 microversion: 2.1 time: 0.537472 Sep 19 11:26:57.560769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 131/269] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:26:57 2022] POST /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45/action => generated 0 bytes in 540 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:26:57.571705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:57.573378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:57.586754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.587281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.588410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.590923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.591425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.591854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.904882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:57.905747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:57.919418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.920190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.921286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.925657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:57.926063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:57.927672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:57.943367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:57.959497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fad69eea-61ba-4782-b913-6496602de1db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1509 microversion: 2.1 time: 0.393303 Sep 19 11:26:57.961506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 139/270] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:57 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1509 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:58.305131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:58.326929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7a5c517e-9960-45dc-9987-d394471c1d54 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1313 microversion: 2.1 time: 0.427911 Sep 19 11:26:58.335489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 132/271] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:57 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1313 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:58.532134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:58.533265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:58.546867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:58.548209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:58.549948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:58.550852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:58.554396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:58.554838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:58.617304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e44a894-e5f9-43ea-b526-431096d42f21 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/ips" status: 200 len: 145 microversion: 2.1 time: 0.090498 Sep 19 11:26:58.627425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 140/272] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 11:26:58 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/ips => generated 145 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:26:58.992963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:58.995204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:59.019082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:59.025108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:26:59.028874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.033691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.033691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.033691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.033691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.034077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.361469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:26:59.362417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:26:59.376025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.376550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.376990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.383870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:26:59.384569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:26:59.385403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:26:59.423568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:59.432496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fb5229a7-1b50-4406-816d-1c23d2e3a190 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1509 microversion: 2.1 time: 0.445506 Sep 19 11:26:59.435127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 133/273] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:58 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1509 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:26:59.691484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:26:59.725252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-363caf48-5bd6-4bca-a7f7-2c99025a68c6 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1313 microversion: 2.1 time: 0.370218 Sep 19 11:26:59.726770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 141/274] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:26:59 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1313 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:00.466499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:00.467289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:00.481089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:00.481690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:00.482136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:00.482861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:00.483350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:00.483849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:00.753331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:00.754565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:00.775158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:00.800587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:00.801074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:00.801512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:00.802252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:00.802687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:00.803112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:01.035280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:01.047997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-67ea8d44-945f-439c-842a-a8efca672ec6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1509 microversion: 2.1 time: 0.582810 Sep 19 11:27:01.050240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 134/275] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:00 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1509 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:01.114881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:01.129325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ecfb0422-e298-4e07-a9be-c83ee4cf1449 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1313 microversion: 2.1 time: 0.380425 Sep 19 11:27:01.145511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 142/276] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:00 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1313 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:01.643242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c87d08a-422f-4f03-bd01-7e59cd613712"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:01.643821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:01.680902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:01.681408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:01.682461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:01.683145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:01.683647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:01.684068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.077051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:02.077669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:02.140849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.145496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.149162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.161973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.169353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.169850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.711964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:02.721339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a56825b2-c1a7-4fb8-8901-18ac184e3154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1515 microversion: 2.1 time: 0.650202 Sep 19 11:27:02.726906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 143/277] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:02 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1515 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:02.732013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:02.737408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:02.751549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=78 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:02.753397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.754239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.754834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.755907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:02.756525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:02.762314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:02.790801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-afea755f-02b8-4bd5-85ef-b09d1fff75cc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.158039 Sep 19 11:27:02.792309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 135/278] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 11:27:01 2022] POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-volume_attachments => generated 194 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:03.208217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-13b5bb8b-333c-44f5-9f97-ae027786b919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'create', calling method: .version_select at 0x7f4b9a8c7a60>, body: {"keypair": {"name": "tempest-keypair-1188245809", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPKB37NvsUspHdAF92u5OFEGECBXg4eD1/KA1eia/1IHKr+vfyUaE9+H8hVhiHnNtIIMsbfVk/lHil9e2qwiMgPSQKtOe2DzU3yB+zqkyAqsSNG3LRyMVDifTaDIkkXZPg=="}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:03.253812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-13b5bb8b-333c-44f5-9f97-ae027786b919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:03.265790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-13b5bb8b-333c-44f5-9f97-ae027786b919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for user 5a8fb193bdd1448eab774bd1eef437c9 and project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:03.453916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:03.468159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3e691a92-33c4-46ea-9547-8b87ab295865 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1313 microversion: 2.1 time: 0.739833 Sep 19 11:27:03.468935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 144/279] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:02 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1313 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:03.524693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-13b5bb8b-333c-44f5-9f97-ae027786b919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.730915 Sep 19 11:27:03.526692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 136/280] 10.222.0.78 () {62 vars in 1200 bytes} [Mon Sep 19 11:27:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 733 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 11:27:04.463621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-8d2000a0-f019-4a88-84aa-4d732de1cc28 req-95f83d74-e44f-45dd-8b29-81dbfbd0855c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cffff86-6639-4581-81ea-bf21a264ad10", "name": "network-vif-plugged", "status": "completed", "tag": "3d3232b3-ccde-4d00-843e-c4b54b1b1d82"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:04.483507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8d2000a0-f019-4a88-84aa-4d732de1cc28 req-95f83d74-e44f-45dd-8b29-81dbfbd0855c service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:04.484271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8d2000a0-f019-4a88-84aa-4d732de1cc28 req-95f83d74-e44f-45dd-8b29-81dbfbd0855c service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:04.484867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8d2000a0-f019-4a88-84aa-4d732de1cc28 req-95f83d74-e44f-45dd-8b29-81dbfbd0855c service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:04.497571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:04.498495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:04.499110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-8d2000a0-f019-4a88-84aa-4d732de1cc28 req-95f83d74-e44f-45dd-8b29-81dbfbd0855c service nova] Creating event network-vif-plugged:3d3232b3-ccde-4d00-843e-c4b54b1b1d82 for instance 2cffff86-6639-4581-81ea-bf21a264ad10 on hv-cinder-82282 Sep 19 11:27:04.504631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-8d2000a0-f019-4a88-84aa-4d732de1cc28 req-95f83d74-e44f-45dd-8b29-81dbfbd0855c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045104 Sep 19 11:27:04.505882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 145/281] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:04.511374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:04.511877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:04.529812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:04.531278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:04.532490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:04.533228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:04.854753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7acf41a2-1577-49f0-8eb0-e6ab8d29dae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'create', calling method: .version_select at 0x7f4b9a690670>, body: {"keypair": {"name": "tempest-keypair-1174002775", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB4JVloaR5TKp9siF5fry8llk3CujEnZOcFZys29iULH7JmKU0ooWI8KjUoeFJPT2kswCJ7y1s/fw7zUD8wWl1L1ysReBRalc2qZLURHxL1l+Eo9GzYM/5akR3ZMvDCLFQ=="}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:04.925673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-7acf41a2-1577-49f0-8eb0-e6ab8d29dae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:04.937114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-7acf41a2-1577-49f0-8eb0-e6ab8d29dae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for user d6fee905418f4d879da460b6758d4f23 and project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:04.982745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:04.987032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-72ed25eb-9265-45ab-915e-56b239bcd120 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1313 microversion: 2.1 time: 0.495203 Sep 19 11:27:05.006840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 137/282] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:04 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1313 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:05.098012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7acf41a2-1577-49f0-8eb0-e6ab8d29dae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.250115 Sep 19 11:27:05.100672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 146/283] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 11:27:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:27:06.022452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:06.023926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:06.040218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.043985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.045546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.050009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:06.053002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:06.054053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:06.351381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:06.375807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70e326b0-d6ce-48e8-a34a-33adc27a80dd tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1313 microversion: 2.1 time: 0.358611 Sep 19 11:27:06.381210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 138/284] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:06 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:07.403145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:07.403959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:07.418466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:07.435044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:07.435925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:07.437850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:07.439424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:07.440876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:08.073007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:08.091054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-08da36a0-e25e-42ff-8974-bb7cc02bd760 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1496 microversion: 2.1 time: 0.693112 Sep 19 11:27:08.092194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 147/285] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:07 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1496 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:09.487363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1489893197", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f739e757-0e77-4020-9623-8f44464bfc43"}], "security_groups": [{"name": "tempest-securitygroup--1758045349"}], "key_name": "tempest-keypair-1188245809", "user_data": "}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:09.539449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:09.824363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:09.824974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:09.837057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:09.840367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:09.841162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:09.842373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:09.843450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:09.845255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:09.921815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:27:09.925681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] validate_networks() for [('f739e757-0e77-4020-9623-8f44464bfc43', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:27:10.903344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:27:10.903344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:27:10.903344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:27:10.903344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:27:10.903344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:27:10.920679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.924054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.924760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:10.925761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:10.926298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:10.926738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:11.017005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:11.040856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for user 5a8fb193bdd1448eab774bd1eef437c9 and project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:11.074712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:27:11.079256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:27:11.172596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-90956bcc-3f42-4f7a-b444-c37406e2cb96 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "DELETE /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 204 len: 0 microversion: 2.1 time: 1.352672 Sep 19 11:27:11.173482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 148/286] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:27:09 2022] DELETE /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 0 bytes in 1354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:27:11.205461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:11.205461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:11.230709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:11.230709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:11.230709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:11.230709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:11.231048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:11.236689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:11.285516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45d89c01-c493-401f-815b-2693d49a1c98 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.805554 Sep 19 11:27:11.286173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 139/287] 10.222.0.78 () {62 vars in 1188 bytes} [Mon Sep 19 11:27:09 2022] POST /compute/v2.1/servers => generated 402 bytes in 1807 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 11:27:11.300453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f7ee5bc5-0849-4a58-9114-5323994c2a73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:11.305724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f7ee5bc5-0849-4a58-9114-5323994c2a73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:11.628177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7ee5bc5-0849-4a58-9114-5323994c2a73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:11.642695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7ee5bc5-0849-4a58-9114-5323994c2a73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:11.657431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7ee5bc5-0849-4a58-9114-5323994c2a73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:11.658608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f7ee5bc5-0849-4a58-9114-5323994c2a73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1282 microversion: 2.20 time: 0.364053 Sep 19 11:27:11.659206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 140/288] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1282 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:11.683126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-642877330", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f8725e24-32ff-48e9-8c98-5e2c3e121e45"}], "security_groups": [{"name": "tempest-securitygroup--461031233"}], "key_name": "tempest-keypair-1174002775", "user_data": "}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:12.075900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] validate_networks() for [('f8725e24-32ff-48e9-8c98-5e2c3e121e45', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:27:12.282304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:12.290807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c24c4997-dba2-4ea5-862f-cadf2660c27e tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1502 microversion: 2.1 time: 1.108813 Sep 19 11:27:12.291936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 149/289] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:11 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1502 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:12.314689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9fc343d8-4b21-478b-9713-62e05000daca tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:12.340955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fc343d8-4b21-478b-9713-62e05000daca tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:12.341447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fc343d8-4b21-478b-9713-62e05000daca tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:12.341880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fc343d8-4b21-478b-9713-62e05000daca tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:12.539863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9fc343d8-4b21-478b-9713-62e05000daca tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Going to try to stop instance {{(pid=121085) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 11:27:12.866168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9fc343d8-4b21-478b-9713-62e05000daca tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action" status: 202 len: 0 microversion: 2.1 time: 0.560293 Sep 19 11:27:12.872397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 150/290] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:27:12 2022] POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action => generated 0 bytes in 568 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:27:12.909143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e9de7976-7183-4c53-b63f-94f6767a5c1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:12.913203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e9de7976-7183-4c53-b63f-94f6767a5c1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:13.200636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e9de7976-7183-4c53-b63f-94f6767a5c1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:13.209380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e9de7976-7183-4c53-b63f-94f6767a5c1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:13.210750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e9de7976-7183-4c53-b63f-94f6767a5c1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:13.211934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e9de7976-7183-4c53-b63f-94f6767a5c1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1282 microversion: 2.20 time: 0.337015 Sep 19 11:27:13.212504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 151/291] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1282 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:13.238725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:13.239380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:13.253651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:13.254149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:13.254586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:13.255319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:13.255780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:13.256207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.284751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:27:14.285212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:27:14.285498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:27:14.285912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:27:14.286376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:27:14.324876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.325599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.326741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.329589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.330608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.334041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.371319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:14.376176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Getting quotas for user d6fee905418f4d879da460b6758d4f23 and project 7f4d504e02a645b6a5ebc78ed0bc5a41. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:14.416523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:27:14.419440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:27:14.481787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:14.496066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0a01b368-2243-45dd-840c-aa48426982e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 1.263986 Sep 19 11:27:14.497434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 152/292] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:13 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 1284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:14.502644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:14.503413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:14.521923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.523345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.523345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.524390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.525682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.526345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.621067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e0233a26-1d1b-44a6-aecd-6c9f441f0813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 2.951623 Sep 19 11:27:14.621694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 141/293] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:27:11 2022] POST /compute/v2.1/servers => generated 408 bytes in 2953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:27:14.640992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-d0f5e41c-9dc5-454d-a66d-eb49a24c94a2 req-04579e3f-fe07-4a0b-b99f-3bb796311718 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2cffff86-6639-4581-81ea-bf21a264ad10", "name": "network-vif-deleted", "tag": "3d3232b3-ccde-4d00-843e-c4b54b1b1d82"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:14.667810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d0f5e41c-9dc5-454d-a66d-eb49a24c94a2 req-04579e3f-fe07-4a0b-b99f-3bb796311718 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.672407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d0f5e41c-9dc5-454d-a66d-eb49a24c94a2 req-04579e3f-fe07-4a0b-b99f-3bb796311718 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.672407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d0f5e41c-9dc5-454d-a66d-eb49a24c94a2 req-04579e3f-fe07-4a0b-b99f-3bb796311718 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.703900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-d0f5e41c-9dc5-454d-a66d-eb49a24c94a2 req-04579e3f-fe07-4a0b-b99f-3bb796311718 service nova] Creating event network-vif-deleted:3d3232b3-ccde-4d00-843e-c4b54b1b1d82 for instance 2cffff86-6639-4581-81ea-bf21a264ad10 on hv-cinder-82282 Sep 19 11:27:14.727893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-d0f5e41c-9dc5-454d-a66d-eb49a24c94a2 req-04579e3f-fe07-4a0b-b99f-3bb796311718 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090469 Sep 19 11:27:14.736176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 142/294] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:14.747653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:14.748576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:14.771804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.773027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.775350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.776397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:14.777731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:14.779157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:14.843363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:14.863669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a06cfa5-baa0-4593-8b0d-f0249e66d305 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1298 microversion: 2.1 time: 0.361331 Sep 19 11:27:14.869609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 153/295] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:14 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1298 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:14.885287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce382087-fbf8-4a33-b1ab-23e3964233df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:14.885914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce382087-fbf8-4a33-b1ab-23e3964233df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:15.177241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:15.188774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:15.190268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:15.199765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-38e61d5a-a10c-42eb-81c6-19ee47d522dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1334 microversion: 2.20 time: 0.466716 Sep 19 11:27:15.201391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 143/296] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1334 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:15.266026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce382087-fbf8-4a33-b1ab-23e3964233df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:15.272391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce382087-fbf8-4a33-b1ab-23e3964233df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1245 microversion: 2.1 time: 0.400276 Sep 19 11:27:15.276671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 154/297] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1245 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:15.524748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:15.527367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:15.543044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:15.544212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:15.544915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:15.546340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:15.547047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:15.548590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:15.555131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:15.904626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:15.911857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:15.933867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:15.934480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:15.934988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:15.935850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:15.936503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:15.937060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:15.958108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:15.970765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7265115d-ab74-49db-96e1-f1120cc2ca7b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 0.449982 Sep 19 11:27:15.975444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 144/298] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:15 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:16.000190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:16.000752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:16.001245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:16.002239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lazy-loading 'fault' on Instance uuid 2cffff86-6639-4581-81ea-bf21a264ad10 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:27:16.005871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:16.249994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:16.269798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:16.293192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:16.295485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:16.300235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:16.307205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:16.310875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:16.314504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:16.625326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e81d8e2a42f34cc0b4f3ca54eb203f59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '47fc574b240e4a09bb83d1d2f20558c4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:16.636774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49309cd7-0c51-4bfb-9847-2d6bcdb6366f tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 200 len: 1303 microversion: 2.1 time: 0.743712 Sep 19 11:27:16.643781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 155/299] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:15 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 1303 bytes in 751 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:16.659409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:16.669581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:16.680934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:16.684188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:16.686741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:16.687616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:16.690318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:16.690954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:16.713581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:16.744420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:16.749502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:16.754193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-742cde73-0c80-4d91-83bf-3566fcf3c40b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1340 microversion: 2.20 time: 0.519765 Sep 19 11:27:16.756350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 145/300] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1340 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:16.888025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:16.903452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3326a35b-d7b6-4ca5-b028-06655b1d872e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1249 microversion: 2.1 time: 0.256477 Sep 19 11:27:16.906197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 156/301] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1249 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:17.007912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:17.009826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:17.024895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.035077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.035757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.036866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.037508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.038112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.461539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:17.489423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b0cf866e-b77a-43f6-b014-edd67c3dc314 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 0.491024 Sep 19 11:27:17.506200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 146/302] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:16 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:17.663720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:17.664629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] [instance: 2cffff86-6639-4581-81ea-bf21a264ad10] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:17.692948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.696715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.701313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.703463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.705379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.708065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.741674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] HTTP exception thrown: Instance 2cffff86-6639-4581-81ea-bf21a264ad10 could not be found. Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Request method failure captured: Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 HTTP/1.1 Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFHSZKOMlGpsksrWP77JgIZrzJSnHBATjCTOqjz7NoE7ZDxoxhEJlaZl3TgSe2a2Y6D1P2NZ8N-szWb3FhXm8cZUJAv3C_sfcc01BxK0D1gwGTvgizQFPDMKr54m8aPpGY5RhVuIONlKHy6vKO-GeN6L-ynInb7Vd7F9SvEnX-2En8o Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 47fc574b240e4a09bb83d1d2f20558c4 Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesActionsTest-400684052 Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:27:17.743429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/47fc574b240e4a09bb83d1d2f20558c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesActionsTest-400684052 Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 47fc574b240e4a09bb83d1d2f20558c4 Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesActionsTest-400684052 Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesActionsTest-400684052-project Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: e81d8e2a42f34cc0b4f3ca54eb203f59 Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesActionsTest-400684052-project Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 2cffff86-6639-4581-81ea-bf21a264ad10 could not be found. Sep 19 11:27:17.745578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '2cffff86-6639-4581-81ea-bf21a264ad10'} Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2cffff86-6639-4581-81ea-bf21a264ad10 could not be found. Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:27:17.746493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2cffff86-6639-4581-81ea-bf21a264ad10 could not be found. Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2cffff86-6639-4581-81ea-bf21a264ad10 could not be found. Sep 19 11:27:17.747989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:27:17.754495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] Returning 404 to user: Instance 2cffff86-6639-4581-81ea-bf21a264ad10 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:27:17.756881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-290a4f47-a5ee-4c4b-9e21-68cb30a79610 tempest-VolumesActionsTest-400684052 tempest-VolumesActionsTest-400684052-project] 10.222.0.78 "GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10" status: 404 len: 111 microversion: 2.1 time: 0.098971 Sep 19 11:27:17.765400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 157/303] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:17 2022] GET /compute/v2.1/servers/2cffff86-6639-4581-81ea-bf21a264ad10 => generated 111 bytes in 108 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:27:17.782066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:17.782951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:17.804116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.804701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.805849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.808143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.812948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.813420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.935288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:17.935288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:17.944665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.945507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.962669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:17.965353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:17.972057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:17.972738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:18.381992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:18.392572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-65448a2b-425a-42e7-b9cd-89a8d1d632b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1297 microversion: 2.1 time: 0.466028 Sep 19 11:27:18.414381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 158/304] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1297 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:18.514251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:18.515064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:18.525970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:18.532857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:18.533405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:18.534242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:18.534721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:18.535156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:18.550155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:18.581712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:18.584129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:18.585756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fca5ff59-3ad1-47ab-bf6d-44d6d089dc31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.807777 Sep 19 11:27:18.587031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 147/305] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:18.995430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:19.010040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a0858816-ce7d-4db8-8513-24df28e1e8c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 0.499340 Sep 19 11:27:19.014537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 159/306] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:18 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:19.436100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:19.436619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:19.451205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:19.451722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:19.452170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:19.452932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:19.453395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:19.453823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:19.597456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-e17cc239-f6fe-4cd5-a2b7-ab111c3e0cf7 req-11c4ef42-2ea6-42a0-aebc-2a3533514e63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:19.622684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-e17cc239-f6fe-4cd5-a2b7-ab111c3e0cf7 req-11c4ef42-2ea6-42a0-aebc-2a3533514e63 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:19.626445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-e17cc239-f6fe-4cd5-a2b7-ab111c3e0cf7 req-11c4ef42-2ea6-42a0-aebc-2a3533514e63 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:19.626959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-e17cc239-f6fe-4cd5-a2b7-ab111c3e0cf7 req-11c4ef42-2ea6-42a0-aebc-2a3533514e63 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:19.663198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-e17cc239-f6fe-4cd5-a2b7-ab111c3e0cf7 req-11c4ef42-2ea6-42a0-aebc-2a3533514e63 service nova] Creating event network-changed:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 11:27:19.682996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-e17cc239-f6fe-4cd5-a2b7-ab111c3e0cf7 req-11c4ef42-2ea6-42a0-aebc-2a3533514e63 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086777 Sep 19 11:27:19.688375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 160/307] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:27:19.705553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:19.707098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:19.709041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:19.721989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2bce38d7-55f7-4f6c-aa2c-df353b27e15f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1303 microversion: 2.1 time: 0.303029 Sep 19 11:27:19.723653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 148/308] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1303 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:19.736940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:19.740075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:19.743406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:19.744365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:19.744836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:19.751279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:20.041759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:20.042872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:20.056286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:20.058678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:20.060336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:20.067045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:20.069425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:20.070119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:20.627615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:20.650268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0513a455-12d5-4260-b7ab-ff775642ec51 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 0.612881 Sep 19 11:27:20.667825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 149/309] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:20 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:20.750155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:20.751341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:20.766194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:20.776494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:20.779275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:20.780378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:20.781086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:20.782885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.014663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:21.027006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:21.031315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:21.033675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-70d30b9d-b916-4567-9661-673bc13af4ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 1.342784 Sep 19 11:27:21.044415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 161/310] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 1355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:21.099968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:21.112823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-448c0fd7-47d4-4db0-b470-350359ff4925 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1303 microversion: 2.1 time: 0.366879 Sep 19 11:27:21.131933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 150/311] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1303 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:21.697815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:21.698638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:21.708212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.710331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.711008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.715107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:21.715834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:21.716461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:21.970432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:21.983231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc9433dc-dc34-4d06-8156-24d62c964124 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 0.290215 Sep 19 11:27:21.984522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 162/312] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:21 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:22.066007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:22.066770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:22.088439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.094040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.094040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:22.094040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.094040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.094419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:22.141271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:22.142012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:22.156795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.156795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.158968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:22.158968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:22.161757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:22.163648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:22.542699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:22.552213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:22.553976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:22.555395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3443ff80-0430-4aa6-8d3a-892022b58747 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.493902 Sep 19 11:27:22.557343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 151/313] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:22.567744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:22.578810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7836860f-e7f1-452a-9c1f-d7fcc2603b3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.441731 Sep 19 11:27:22.579506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 163/314] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:23.018457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:23.019089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:23.029854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.030493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.031021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.032839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.033583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.034149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.236859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:23.248195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-32a414f7-45e8-4da0-9232-a69cb745a769 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 0.238696 Sep 19 11:27:23.249563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 152/315] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:23 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:23.583491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:23.584128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:23.596296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.599143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.599143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.599143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.599143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.604711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.607371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:23.608780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:23.624891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.627686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.628584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.629545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:23.634931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:23.636518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:23.974426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:23.992015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:23.993811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:24.020146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-073ed254-98de-422b-abc1-8bc4412a0d52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.438187 Sep 19 11:27:24.020967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 164/316] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:24.147515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:24.179406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3650daad-816d-404a-9e29-9d07189a2823 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.572956 Sep 19 11:27:24.199539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 153/317] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:24.275341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:24.276140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:24.319675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.320294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.320723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:24.324969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:24.325447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:24.327941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.058504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:25.059194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:25.060020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:25.061241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:25.062450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=18 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:25.089058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.090803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-909d1e2f-938b-4d46-9d8a-31bff871dcfe tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1698 microversion: 2.1 time: 0.820185 Sep 19 11:27:25.091463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 165/318] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:24 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1698 bytes in 822 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:25.092812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.093944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.101558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.101558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.101558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.128322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e3f3291-40c9-47ef-8950-481ba244f26e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:25.157840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3f3291-40c9-47ef-8950-481ba244f26e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.158367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3f3291-40c9-47ef-8950-481ba244f26e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.164229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3f3291-40c9-47ef-8950-481ba244f26e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.272625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e3f3291-40c9-47ef-8950-481ba244f26e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Going to try to start instance {{(pid=121085) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 11:27:25.287717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=8 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:25.632527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e3f3291-40c9-47ef-8950-481ba244f26e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action" status: 202 len: 0 microversion: 2.1 time: 0.515441 Sep 19 11:27:25.636686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 166/319] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:27:25 2022] POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action => generated 0 bytes in 517 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:27:25.659720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:25.660543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:25.667611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:25.685122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.685684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.686141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.686378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:25.686894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.687390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.691509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:25.692212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.695516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fbc840fc-7ad6-4481-a6c5-e099eaa159d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.650665 Sep 19 11:27:25.699801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 154/320] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 657 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:27:25.712766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:25.715323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:25.735431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.736817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.737476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:25.741624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:25.745051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:25.745834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:26.405049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:26.421132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-09e46dd1-b806-45e9-a315-db56511d2649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.786572 Sep 19 11:27:26.424821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 167/321] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:26.589143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:26.602065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bc865e29-1252-4b75-859e-bfa297369e2e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1707 microversion: 2.1 time: 0.896306 Sep 19 11:27:26.623278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 155/322] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:25 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1707 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:26.730334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:26.731303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:26.754982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:26.756014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:26.756686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:26.757565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:26.765563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:26.768841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:26.934133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-71dd8de9-ea53-4772-8310-3c0615fa079d req-5fba6640-7caa-4270-bfdc-4af84cbd043e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3837b49-df54-4e20-a19e-5be03f339e84", "tag": "cbe41e13-72d5-4704-b65e-18b44b17bea1"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:26.955920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-71dd8de9-ea53-4772-8310-3c0615fa079d req-5fba6640-7caa-4270-bfdc-4af84cbd043e service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:26.956410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-71dd8de9-ea53-4772-8310-3c0615fa079d req-5fba6640-7caa-4270-bfdc-4af84cbd043e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:26.956840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-71dd8de9-ea53-4772-8310-3c0615fa079d req-5fba6640-7caa-4270-bfdc-4af84cbd043e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:26.997411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-71dd8de9-ea53-4772-8310-3c0615fa079d req-5fba6640-7caa-4270-bfdc-4af84cbd043e service nova] Creating event network-changed:cbe41e13-72d5-4704-b65e-18b44b17bea1 for instance c3837b49-df54-4e20-a19e-5be03f339e84 on hv-cinder-82282 Sep 19 11:27:27.013036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-71dd8de9-ea53-4772-8310-3c0615fa079d req-5fba6640-7caa-4270-bfdc-4af84cbd043e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082203 Sep 19 11:27:27.015970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 156/323] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:27:27.111724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.124368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.126818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.132143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4df034b7-83ab-41db-bc1a-e5f7cd549fb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.406110 Sep 19 11:27:27.134513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 168/324] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:27.475282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:27.475282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:27.485559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:27.486302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:27.486975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:27.487971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:27.488613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:27.489199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:27.641527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:27.643754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:27.651853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:27.653961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:27.654599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:27.656032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:27.660081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:27.682570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:27.832169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.844054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-660c75fb-e178-4a29-a9f0-413f297f7eeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.394993 Sep 19 11:27:27.848970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 157/325] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:27.959097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:27.974895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-94cd6e46-3ba8-4820-b45e-86689777cff0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1707 microversion: 2.1 time: 0.343905 Sep 19 11:27:27.978683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 169/326] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:27 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1707 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:28.168195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:28.169726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:28.181051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:28.181576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:28.182039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:28.182779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:28.193358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:28.198497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:28.878162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:28.878785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:28.893300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:28.893842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:28.894575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:28.898377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:28.914653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:28.916623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:29.650112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:29.683636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:29.689204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:29.690609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5c7388c5-b52d-4b8b-b8b1-e9319d767d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 1.532135 Sep 19 11:27:29.691668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 158/327] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 1534 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:29.707240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:29.713097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:29.721733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:29.724138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:29.724759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:29.732015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:29.732491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:29.732936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:30.173502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:30.229237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2bc98831-7f78-42a7-ab29-07fb246788c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 1.356294 Sep 19 11:27:30.239943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 170/328] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 1368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:30.365332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:30.388186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-770fcc81-b86a-4350-8330-a9ee4dd45906 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1707 microversion: 2.1 time: 0.692954 Sep 19 11:27:30.412082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 159/329] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:29 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1707 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:30.603102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-96b27081-c562-42a8-b0bb-822460ddb8ff req-ea3b326a-405b-4300-be04-fdd9f89e0f07 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "name": "network-vif-plugged", "status": "completed", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:30.613487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-96b27081-c562-42a8-b0bb-822460ddb8ff req-ea3b326a-405b-4300-be04-fdd9f89e0f07 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:30.615991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-96b27081-c562-42a8-b0bb-822460ddb8ff req-ea3b326a-405b-4300-be04-fdd9f89e0f07 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:30.622689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-96b27081-c562-42a8-b0bb-822460ddb8ff req-ea3b326a-405b-4300-be04-fdd9f89e0f07 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:30.654942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-96b27081-c562-42a8-b0bb-822460ddb8ff req-ea3b326a-405b-4300-be04-fdd9f89e0f07 service nova] Creating event network-vif-plugged:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 11:27:30.670483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-96b27081-c562-42a8-b0bb-822460ddb8ff req-ea3b326a-405b-4300-be04-fdd9f89e0f07 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071405 Sep 19 11:27:30.671307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 171/330] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:30.724392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:30.725875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:30.747675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:30.748179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:30.751995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:30.754848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:30.755520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:30.756115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:31.225954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.244319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.244593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.245623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d0f6c80a-f84d-4e10-ab92-f4b2e5efac0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.533825 Sep 19 11:27:31.277917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:31.281485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:31.282815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 160/331] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:31.288590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:31.292303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:31.293086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:31.294963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:31.296622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:31.297892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:31.419559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:31.421542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:31.432565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:31.436509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:31.437276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:31.448999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:31.451094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:31.453994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:31.526905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:31.806623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.827390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d9feee23-c464-473f-bde2-837996b69c5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.556799 Sep 19 11:27:31.847634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 172/332] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:31.854973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7512b903-9019-4fc2-af71-77049be546fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Action: 'create', calling method: .version_select at 0x7f4b9a690c10>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1153350230", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOv7SaEj6ofdcmzs1+uaU2FMqKdB4uNUe4g/2DEvBBg/xFocDYf24dc0frpQoEYhd2UtuwcaejGrPAr7tVOM+FeIFqOc4IHAmhLzJpjhADJSEpmagbMrfifrZ81j3kCvtw=="}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:31.909077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:31.922352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-7512b903-9019-4fc2-af71-77049be546fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Getting quotas for project ec8ddabe0fd049de97da2f63453aabef. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:31.939502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-7512b903-9019-4fc2-af71-77049be546fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Getting quotas for user 28638075e935490bb7c8c229de9d14c5 and project ec8ddabe0fd049de97da2f63453aabef. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:31.953135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-143c904f-e691-425f-b2be-a927ef48fc5c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1711 microversion: 2.1 time: 0.540411 Sep 19 11:27:31.968900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 161/333] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:31 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1711 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:32.121949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7512b903-9019-4fc2-af71-77049be546fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.272766 Sep 19 11:27:32.130536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 173/334] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 11:27:31 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:32.270167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:32.270833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:32.279411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:32.282755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:32.283969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:32.288437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2000011160", "imageRef": "29c7b192-a2ff-4c4a-b946-b65697f3dd5a", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1153350230", "networks": [{"uuid": "875a8fe6-2ace-48e5-b61e-bade73fe31e1"}]}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:32.288954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:32.288954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:32.288954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:32.430314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] validate_networks() for [('875a8fe6-2ace-48e5-b61e-bade73fe31e1', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:27:32.732331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:32.749167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:32.750851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:32.752189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a387400b-a6ac-4223-8e74-684253f753a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.486049 Sep 19 11:27:32.753256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 162/335] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:32.856411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:32.857189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:32.867464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:32.867464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:32.867464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:32.873890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:32.874688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:32.875396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:33.508043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:33.519255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-787dec0d-ad79-457e-ba1c-bfe7b588befa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.667072 Sep 19 11:27:33.531695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 163/336] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:33.787446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:33.788604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:33.801997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:33.802875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:33.803625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:33.804761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:33.806195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:33.807318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:33.843359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:27:33.843359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:27:33.843359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:27:33.844621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:27:33.845219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:27:33.867634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:33.868940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:33.869435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:33.870256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:33.871045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:33.871670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:33.885167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:33.898549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Getting quotas for project ec8ddabe0fd049de97da2f63453aabef. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:33.901921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:33.904748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Getting quotas for user 28638075e935490bb7c8c229de9d14c5 and project ec8ddabe0fd049de97da2f63453aabef. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:33.954036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:27:33.956825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='29c7b192-a2ff-4c4a-b946-b65697f3dd5a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:27:34.019362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.031678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.034427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.036969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-17503ddd-ba0c-4c0f-a635-f95b08a0b303 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1408 microversion: 2.20 time: 0.255108 Sep 19 11:27:34.061152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 164/337] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:27:34.156875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-98385a80-ddfa-4735-adf7-cf1a4736a40e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.881739 Sep 19 11:27:34.164851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 174/338] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:27:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 1892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 11:27:34.173127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1818f239-345e-407e-9505-4b313c80812f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:34.176188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1818f239-345e-407e-9505-4b313c80812f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:34.304469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1818f239-345e-407e-9505-4b313c80812f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.335940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1818f239-345e-407e-9505-4b313c80812f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1259 microversion: 2.1 time: 0.168922 Sep 19 11:27:34.338225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 165/339] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:34.547477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:34.550125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:34.570062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:34.570656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:34.571015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:34.571829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:34.572303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:34.572742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:34.864649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:34.885471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d1aef1c1-108b-4b5c-8721-a560ccd8ae14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.343855 Sep 19 11:27:34.886314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 175/340] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:35.070143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:35.070751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:35.078536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.079153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.079648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:35.080346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.082812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.085860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:35.298261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:35.317018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:35.318833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:35.320243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f60cfa1e-a99d-4273-9339-eab72bb5f5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1600 microversion: 2.20 time: 0.254359 Sep 19 11:27:35.321014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 166/341] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:27:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1600 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:27:35.350700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:35.351497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:35.364719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-474e66be-8d44-4411-a8e1-adc8cd52ea2a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:35.365630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-474e66be-8d44-4411-a8e1-adc8cd52ea2a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:35.368101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.368599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.375639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:35.378632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.379126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.379612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:35.503052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-474e66be-8d44-4411-a8e1-adc8cd52ea2a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:35.519662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-474e66be-8d44-4411-a8e1-adc8cd52ea2a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1259 microversion: 2.1 time: 0.151294 Sep 19 11:27:35.520362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 167/342] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:35.616375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a3fa5d68-9ab1-4343-8231-6187c929823e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.269839 Sep 19 11:27:35.617287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 176/343] 10.222.0.78 () {60 vars in 1316 bytes} [Mon Sep 19 11:27:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-interface => generated 285 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:27:35.913959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:35.916737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:35.924148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.924638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.929390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:35.929390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:35.939048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:35.939530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:36.404825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:36.423998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-81efe20f-c9ad-4757-8b44-03bf6a0f6a14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.505419 Sep 19 11:27:36.431189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 168/344] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:36.548267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:36.548896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:36.558120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:36.558956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:36.559839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:36.564688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:36.565502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:36.566311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:36.724825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:36.778799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a71ac5f1-6343-4a49-8ff2-a7fa30802d51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1255 microversion: 2.1 time: 0.230486 Sep 19 11:27:36.786320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 177/345] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1255 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:37.455191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:37.457031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:37.483340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:37.484972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:37.486610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:37.487726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:37.492475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:37.493910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:37.818148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:37.818907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:37.834367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:37.840545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:37.854409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:37.857799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:37.858376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:37.860412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:38.449383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:38.506526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-04186efe-c038-4dda-8a10-0fe4d4f89e9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1319 microversion: 2.1 time: 0.694870 Sep 19 11:27:38.531636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 178/346] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1319 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:38.536739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-a88abf24-be75-441c-945b-536d28ef5bde req-e5231957-66d8-4fc8-8a60-883f872b1d7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:38.551477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:38.556307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-a88abf24-be75-441c-945b-536d28ef5bde req-e5231957-66d8-4fc8-8a60-883f872b1d7b service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:38.557273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-a88abf24-be75-441c-945b-536d28ef5bde req-e5231957-66d8-4fc8-8a60-883f872b1d7b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:38.558128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-a88abf24-be75-441c-945b-536d28ef5bde req-e5231957-66d8-4fc8-8a60-883f872b1d7b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:38.574439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-a88abf24-be75-441c-945b-536d28ef5bde req-e5231957-66d8-4fc8-8a60-883f872b1d7b service nova] Creating event network-changed:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 11:27:38.606257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1092f446-c91e-4c27-bf7e-b4338febdf97 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 1.136088 Sep 19 11:27:38.607504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-a88abf24-be75-441c-945b-536d28ef5bde req-e5231957-66d8-4fc8-8a60-883f872b1d7b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056090 Sep 19 11:27:38.607504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 179/347] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:38.607742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 169/348] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 1142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:39.049539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-33c75a01-e010-4148-b462-3222b2ee5b22 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Action: 'create', calling method: .version_select at 0x7f4b9a738f70>, body: {"keypair": {"name": "tempest-TestShelveInstance-727516199", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFBeArlLuFrWK7D1Aj/Xn3o0s3xhK8mrIRpOadouypx+EGkBAqopdVyGIEMBpkNoYCKS/aQR+ndvKe/nP+uVEkJ+L6dAE1hKVpQhztMu4dY297wRz3Q3kV3+dIN6lOzw0g=="}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:39.132049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-33c75a01-e010-4148-b462-3222b2ee5b22 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Getting quotas for project 4f82c67c47c243f594cd2bab7ac861aa. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:27:39.143930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-33c75a01-e010-4148-b462-3222b2ee5b22 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Getting quotas for user 792178b0829f49c2b5729aeee1805e77 and project 4f82c67c47c243f594cd2bab7ac861aa. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:27:39.285432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-33c75a01-e010-4148-b462-3222b2ee5b22 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.629430 Sep 19 11:27:39.292933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 180/349] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 11:27:38 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:39.536113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:39.537592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:39.552667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:39.557566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:39.567296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:39.567296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:39.567296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:39.567296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:39.567700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:39.632378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:39.634147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:39.652224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:39.654521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:39.654521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:39.658319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:39.659127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:39.661126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:39.931630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:39.954496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0a4cd5f1-2fe9-4458-87f8-45d84ceb1f41 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1317 microversion: 2.1 time: 0.420160 Sep 19 11:27:39.962664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 170/350] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1317 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:40.390187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:40.407757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9758e413-5b08-417f-a4a4-29dd997f18e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.778636 Sep 19 11:27:40.412804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 181/351] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:40.989368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:40.990074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:41.004167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:41.004939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:41.005582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:41.006821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:41.007553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:41.009896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:41.289075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-7679458e-ab74-4e43-9cbd-179f8dc5c0d3 req-8b22767d-2773-4f7d-bd77-7fc4c27f856e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3837b49-df54-4e20-a19e-5be03f339e84", "name": "network-vif-plugged", "status": "completed", "tag": "cbe41e13-72d5-4704-b65e-18b44b17bea1"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:41.328696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7679458e-ab74-4e43-9cbd-179f8dc5c0d3 req-8b22767d-2773-4f7d-bd77-7fc4c27f856e service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:41.332055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7679458e-ab74-4e43-9cbd-179f8dc5c0d3 req-8b22767d-2773-4f7d-bd77-7fc4c27f856e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:41.332946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7679458e-ab74-4e43-9cbd-179f8dc5c0d3 req-8b22767d-2773-4f7d-bd77-7fc4c27f856e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:41.369316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-7679458e-ab74-4e43-9cbd-179f8dc5c0d3 req-8b22767d-2773-4f7d-bd77-7fc4c27f856e service nova] Creating event network-vif-plugged:cbe41e13-72d5-4704-b65e-18b44b17bea1 for instance c3837b49-df54-4e20-a19e-5be03f339e84 on hv-cinder-82282 Sep 19 11:27:41.385044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-7679458e-ab74-4e43-9cbd-179f8dc5c0d3 req-8b22767d-2773-4f7d-bd77-7fc4c27f856e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102697 Sep 19 11:27:41.390441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 182/352] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:27:41.441092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:41.444787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:41.463501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:41.470915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:41.471657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:41.473399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:41.475074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:41.476116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:42.281905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:42.300534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e3e4463-21a6-437d-8cdc-7bbf86c2f400 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.865490 Sep 19 11:27:42.318747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 183/353] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 885 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:42.359556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:42.373107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e3377fbe-68bf-4dab-98ac-9627a89f40f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 1.388631 Sep 19 11:27:42.376391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 171/354] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 1392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:43.154026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-d0de0270-50db-42b4-8bbf-91be13467068 req-a4081fcf-3bb4-4e6e-bd66-0454eb72f5a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416dd466-0154-4d9a-af4a-9f87010ce3a3", "tag": "6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:43.170423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-d0de0270-50db-42b4-8bbf-91be13467068 req-a4081fcf-3bb4-4e6e-bd66-0454eb72f5a5 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:43.174194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-d0de0270-50db-42b4-8bbf-91be13467068 req-a4081fcf-3bb4-4e6e-bd66-0454eb72f5a5 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:43.174194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-d0de0270-50db-42b4-8bbf-91be13467068 req-a4081fcf-3bb4-4e6e-bd66-0454eb72f5a5 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:43.202898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-d0de0270-50db-42b4-8bbf-91be13467068 req-a4081fcf-3bb4-4e6e-bd66-0454eb72f5a5 service nova] Creating event network-changed:6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 for instance 416dd466-0154-4d9a-af4a-9f87010ce3a3 on hv-cinder-82282 Sep 19 11:27:43.216980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-d0de0270-50db-42b4-8bbf-91be13467068 req-a4081fcf-3bb4-4e6e-bd66-0454eb72f5a5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067542 Sep 19 11:27:43.219419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 184/355] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:43.326129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:43.327018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:43.341402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:43.343386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:43.345653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:43.350624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:43.354700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:43.357311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:43.402536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:43.403807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:43.433156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:43.433156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:43.433156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:43.433156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:43.433613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:43.433613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:43.868486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:43.889899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:43.894274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:43.894520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-20e3e54a-5f26-405c-9ebf-1858240207b7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1370 microversion: 2.1 time: 0.573422 Sep 19 11:27:43.897192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 172/356] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1370 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:43.909398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2f05373a-8515-47ac-83e3-2a366dcbdbc1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.515704 Sep 19 11:27:43.912713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 185/357] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:44.922670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:44.928327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:44.938198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:44.940084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:44.949720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:44.953191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:44.954277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:44.955207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:44.957293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:44.957593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:44.964202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:44.964353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:44.964454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:44.966310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:44.966979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:44.969287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:45.507935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:45.686126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:45.689586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:45.701394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b51110db-e49f-4cba-85a8-773b134c45a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1564 microversion: 2.1 time: 0.782721 Sep 19 11:27:45.702732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 173/358] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1564 bytes in 785 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:45.705462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3f851568-3c39-484e-813c-8af0eca9a4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.773787 Sep 19 11:27:45.707495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 186/359] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:27:45.734048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:45.738292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:45.759559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:45.761570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:45.763801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:45.769355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:45.769355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:45.769355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:45.987008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a0c2fcdb-02d3-49b3-9340-2715a60586e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.259840 Sep 19 11:27:46.000607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 174/360] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 11:27:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-interface => generated 285 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:46.737346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:46.739295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:46.764401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:46.766151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:46.767625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:46.769098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:46.771963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:46.772415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:47.170844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:47.187914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b4a65968-8425-4bc3-85ef-89ee8a0ae5f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.457256 Sep 19 11:27:47.190239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 187/361] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:48.216314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:48.217369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:48.234075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:48.243833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:48.245338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:48.248724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:48.249577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:48.250244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:48.533267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:48.553194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-306da71c-f443-48f0-9c0a-4f4c0e434c70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.342417 Sep 19 11:27:48.569268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 175/362] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:49.217532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-9ec21893-1a29-4baf-ad8b-f77494082265 req-7ed0e80e-1823-47be-8cef-ac301a18fdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3837b49-df54-4e20-a19e-5be03f339e84", "tag": "cbe41e13-72d5-4704-b65e-18b44b17bea1"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:27:49.237006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=14 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:27:49.244052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-9ec21893-1a29-4baf-ad8b-f77494082265 req-7ed0e80e-1823-47be-8cef-ac301a18fdb1 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:49.244897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-9ec21893-1a29-4baf-ad8b-f77494082265 req-7ed0e80e-1823-47be-8cef-ac301a18fdb1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:49.245579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-9ec21893-1a29-4baf-ad8b-f77494082265 req-7ed0e80e-1823-47be-8cef-ac301a18fdb1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:49.272336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-9ec21893-1a29-4baf-ad8b-f77494082265 req-7ed0e80e-1823-47be-8cef-ac301a18fdb1 service nova] Creating event network-changed:cbe41e13-72d5-4704-b65e-18b44b17bea1 for instance c3837b49-df54-4e20-a19e-5be03f339e84 on hv-cinder-82282 Sep 19 11:27:49.283705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-9ec21893-1a29-4baf-ad8b-f77494082265 req-7ed0e80e-1823-47be-8cef-ac301a18fdb1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074691 Sep 19 11:27:49.286275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 188/363] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:27:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:27:49.583629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:49.648248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:49.648248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:49.648248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:49.648248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:49.648754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:49.648754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:49.648754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:49.848069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:49.858023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5fbe73f0-8f94-429f-a0c8-b0699bb1497e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.280158 Sep 19 11:27:49.859573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 176/364] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:50.896657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:50.907241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:50.907241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:50.907241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:50.908328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:50.909986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:50.911308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:50.912522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:51.343298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:51.359150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-943ce185-6e11-4279-b31b-62cdcc466f96 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.473288 Sep 19 11:27:51.360383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 189/365] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:52.391150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:52.393333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:52.422856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.426984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.436193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.436193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:52.436193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:52.436193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:52.635791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:52.644086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-33ebb1ac-d24d-43c3-ac4b-f218a001482c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.260895 Sep 19 11:27:52.645323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 177/366] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:53.675324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:53.678008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:53.691761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:53.692926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:53.693673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:53.694762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:53.695417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:53.696235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:53.875227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:53.884134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e6acf194-cf69-431a-be7f-f590948439f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.213002 Sep 19 11:27:53.884713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 190/367] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:54.921315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:54.923706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:54.934506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:54.935012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:54.939079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:54.940948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:54.941603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:54.944291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:55.153295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:55.167038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1962c680-547d-4893-9f74-fdbe14d1c057 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.260705 Sep 19 11:27:55.168623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 178/368] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:56.192996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:56.192996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:56.198673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.199185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.199619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.200328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:56.200881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:56.201309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:56.406968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:56.416138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-559a8e2e-2970-4cf9-b991-66a3dfd896a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.228075 Sep 19 11:27:56.416702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 191/369] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:57.440454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:57.441060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:57.448483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:57.448983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:57.449419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:57.450134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:57.450586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:57.451011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:57.595635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:57.604355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-17329234-1025-4e39-a2e5-88b45ebe33df tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.167732 Sep 19 11:27:57.604901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 179/370] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:58.629161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:58.629856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:58.637966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:58.650152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:58.650152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:58.650152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:58.650152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:58.650625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:58.843821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:27:58.853391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f6dd2e69-2b1a-48df-bf43-ab34a564a67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.229319 Sep 19 11:27:58.853985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 192/371] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:27:59.877515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:27:59.878430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:27:59.885063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:59.885545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:59.886007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:59.886732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:27:59.887211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:27:59.887648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:27:59.908031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:00.077494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:00.085418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6f1328c4-2b56-46af-ad66-cf308dce3804 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.212215 Sep 19 11:28:00.086141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 180/372] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:27:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:01.114126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:01.114126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:01.120355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:01.120884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:01.121333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:01.122028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:01.122596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:01.123027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:01.281042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:01.289381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2ddb5bce-d76c-4979-8bd8-4a791e2a3275 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.182874 Sep 19 11:28:01.289958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 193/373] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:02.320164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:02.322072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:02.329134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:02.329634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:02.330074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:02.330836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:02.331329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:02.331754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:02.480242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:02.488637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3054dd8f-8813-4ea6-af34-46433efc7166 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.172705 Sep 19 11:28:02.490355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 181/374] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:02.552755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-7b5be5b5-7629-4041-b2f3-a41678c67234 req-bf00fbab-ec2c-4de1-a0aa-5da31dbd9f46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416dd466-0154-4d9a-af4a-9f87010ce3a3", "name": "network-vif-plugged", "status": "completed", "tag": "6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:02.568651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7b5be5b5-7629-4041-b2f3-a41678c67234 req-bf00fbab-ec2c-4de1-a0aa-5da31dbd9f46 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:02.569157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7b5be5b5-7629-4041-b2f3-a41678c67234 req-bf00fbab-ec2c-4de1-a0aa-5da31dbd9f46 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:02.569596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7b5be5b5-7629-4041-b2f3-a41678c67234 req-bf00fbab-ec2c-4de1-a0aa-5da31dbd9f46 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:02.582053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-7b5be5b5-7629-4041-b2f3-a41678c67234 req-bf00fbab-ec2c-4de1-a0aa-5da31dbd9f46 service nova] Creating event network-vif-plugged:6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 for instance 416dd466-0154-4d9a-af4a-9f87010ce3a3 on hv-cinder-82282 Sep 19 11:28:02.587655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-7b5be5b5-7629-4041-b2f3-a41678c67234 req-bf00fbab-ec2c-4de1-a0aa-5da31dbd9f46 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039825 Sep 19 11:28:02.588306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 194/375] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:03.518415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:03.519313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:03.527204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:03.527766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:03.528431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:03.529486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:03.529944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:03.530536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:03.680478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:03.688299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2e2a6b5c-14c2-4ef7-9815-028bfaf75216 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.174022 Sep 19 11:28:03.689082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 182/376] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:04.714981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:04.715869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:04.722260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.722830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.723386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.724152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:04.724617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:04.725044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:04.872808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:04.880893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f9668d1a-2424-457a-ba32-a5c5f37f8604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1359 microversion: 2.1 time: 0.171078 Sep 19 11:28:04.894626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 195/377] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1359 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:05.904588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:05.905341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:05.911794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:05.912252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:05.912926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:05.913568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:05.914587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:05.915155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.055871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:06.063723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f53488e6-7a76-4dc4-ba1e-6cadfa7c16db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1549 microversion: 2.1 time: 0.162978 Sep 19 11:28:06.064558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 183/378] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:06.091924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:06.092648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:06.098674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.099151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.099619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.100330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.100783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.101196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.105979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:06.249938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:06.260990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-02db805e-3da2-4fda-9efa-b09d1b4d656b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1549 microversion: 2.1 time: 0.173069 Sep 19 11:28:06.262293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 196/379] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:06.292197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:06.294433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-650254442", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "networks": [{"uuid": "363967cc-9ec5-4891-b012-fb3aab079d90"}]}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:06.297349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:06.308555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Searching by: {'deleted': False, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef'} {{(pid=121084) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 19 11:28:06.308555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.308555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.308555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.308998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.308998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.308998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.356916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] validate_networks() for [('363967cc-9ec5-4891-b012-fb3aab079d90', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:28:06.405804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.multi_cell_list [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121084) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 19 11:28:06.502743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ecc07384-81d0-47f8-80dc-551d0748ee51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.218055 Sep 19 11:28:06.507477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 184/380] 10.222.0.78 () {58 vars in 1125 bytes} [Mon Sep 19 11:28:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:06.515437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:06.516057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:06.523013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.524104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.524528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.525218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.525662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.526081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.767092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:06.781389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-74c8ff27-75dd-49d7-91b1-5e47bdf9edbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1549 microversion: 2.1 time: 0.270086 Sep 19 11:28:06.782099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 185/381] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1549 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:06.844725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:28:06.845173 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:28:06.845670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:28:06.846075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:28:06.846481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:28:06.848468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:06.856951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.857664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.858293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.866210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:06.866770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:06.867266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:06.886189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Getting quotas for project 575748e2f3ee4df18ce5aa403175b66f. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:28:06.891234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Getting quotas for user 4682f63b56d24450b2605b5b4c2129d9 and project 575748e2f3ee4df18ce5aa403175b66f. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:28:06.903058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:28:06.907241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:28:07.059253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-341b73c4-c99e-4ef9-9129-e816b0b6b954 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.768821 Sep 19 11:28:07.059938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 197/382] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:28:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:28:07.072070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3f8c9e2-2fbf-4725-b793-49a30e913dfd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:07.072683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3f8c9e2-2fbf-4725-b793-49a30e913dfd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:07.134153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3f8c9e2-2fbf-4725-b793-49a30e913dfd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:07.141173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3f8c9e2-2fbf-4725-b793-49a30e913dfd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1218 microversion: 2.1 time: 0.073879 Sep 19 11:28:07.141823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 186/383] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:07 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:07.717472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-771862044", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:07.771079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] validate_networks() for None {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:28:08.073550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:28:08.073978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:28:08.074461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:28:08.074881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:28:08.075344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:28:08.084353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:08.084845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:08.085412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:08.086724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:08.087251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:08.087680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:08.105422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Getting quotas for project 0874e13ae9984c9fbcedb57f7717a73c. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:28:08.109172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Getting quotas for user 4ef532361ce8429ea43232ee36d1a3d4 and project 0874e13ae9984c9fbcedb57f7717a73c. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:28:08.120900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:28:08.123133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:28:08.164298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4bef6768-f86e-4126-b959-51acea75914b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:08.164884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4bef6768-f86e-4126-b959-51acea75914b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:08.219123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4bef6768-f86e-4126-b959-51acea75914b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:08.226465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4bef6768-f86e-4126-b959-51acea75914b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1218 microversion: 2.1 time: 0.066213 Sep 19 11:28:08.227148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 187/384] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:08 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1218 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:08.254664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c40a1f43-1cbd-4526-8d13-82293df068b2 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.541389 Sep 19 11:28:08.255334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 198/385] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:28:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 543 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 11:28:08.268155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-89babbf9-3869-4889-919a-4733d8e1d920 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:08.268989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-89babbf9-3869-4889-919a-4733d8e1d920 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:08.327074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-89babbf9-3869-4889-919a-4733d8e1d920 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:08.334906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-89babbf9-3869-4889-919a-4733d8e1d920 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1214 microversion: 2.1 time: 0.070370 Sep 19 11:28:08.336535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 188/386] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:08 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:08.841403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "be5435fb-bdcd-4d0e-978c-884b5aa32128"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:08.843913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:08.850222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:08.850706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:08.851140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:08.852394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:08.852858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:08.853273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.251388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:09.252765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:09.261293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:09.261805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:09.262247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.262950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:09.263454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:09.263885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:09.344812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:09.354662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e119b6bd-c632-404a-ba4e-bec82633a097 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1270 microversion: 2.1 time: 0.108848 Sep 19 11:28:09.355279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 189/387] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:09 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1270 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:09.366275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-574bbf4f-25c1-4bdb-9fec-2d9a4a691825 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:09.366275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-574bbf4f-25c1-4bdb-9fec-2d9a4a691825 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:09.413469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-574bbf4f-25c1-4bdb-9fec-2d9a4a691825 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:09.421071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-574bbf4f-25c1-4bdb-9fec-2d9a4a691825 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1214 microversion: 2.1 time: 0.064634 Sep 19 11:28:09.421863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 190/388] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:09 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:09.670176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fbb10fc1-f688-4d1e-8ba4-bfb61f464a21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.832635 Sep 19 11:28:09.670754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 199/389] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 11:28:08 2022] POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 194 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:10.380057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:10.380670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:10.389124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.389619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.390411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.391115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.391593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.392016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.444658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:10.445373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:10.451974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.452929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.452929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.453542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:10.453991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:10.454521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:10.454921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:10.463113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1b863b56-ea08-45af-a6d2-2cd6759de053 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1288 microversion: 2.1 time: 0.087705 Sep 19 11:28:10.467214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 191/390] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:10 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1288 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:10.542626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:10.550687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fb331ebb-180c-47bd-b14e-72c7ade3fd80 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1266 microversion: 2.1 time: 0.110840 Sep 19 11:28:10.551465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 200/391] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:10 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1266 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:11.486394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:11.487672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:11.489935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=52 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:11.495263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:11.495747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:11.496218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:11.496906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:11.497528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:11.497950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:11.575055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:11.575867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:11.585378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:11.585378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:11.585378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:11.585378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:11.585832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:11.585832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:11.685055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:11.693875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b2cbef49-c33f-41f0-95a5-436c634284a4 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1274 microversion: 2.1 time: 0.123675 Sep 19 11:28:11.710055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 201/392] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:11 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1274 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:11.732680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:11.740429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45d1e529-5f74-45ff-931e-b94b36b92cda tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.257743 Sep 19 11:28:11.741013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 192/393] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:11 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:12.190921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-2ea6810f-62c5-4f24-a2fc-7b39d8151a11 req-50298d48-51a9-4ddc-bdfb-b0bda9a03141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d86416d5-845e-4334-93a3-1b6702121e18", "tag": "c30d6d3a-57ad-48f7-88d3-2c6f6068da33"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:12.201366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-2ea6810f-62c5-4f24-a2fc-7b39d8151a11 req-50298d48-51a9-4ddc-bdfb-b0bda9a03141 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.201711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-2ea6810f-62c5-4f24-a2fc-7b39d8151a11 req-50298d48-51a9-4ddc-bdfb-b0bda9a03141 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.202219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-2ea6810f-62c5-4f24-a2fc-7b39d8151a11 req-50298d48-51a9-4ddc-bdfb-b0bda9a03141 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:12.215376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-2ea6810f-62c5-4f24-a2fc-7b39d8151a11 req-50298d48-51a9-4ddc-bdfb-b0bda9a03141 service nova] Creating event network-changed:c30d6d3a-57ad-48f7-88d3-2c6f6068da33 for instance d86416d5-845e-4334-93a3-1b6702121e18 on hv-cinder-82282 Sep 19 11:28:12.221169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-2ea6810f-62c5-4f24-a2fc-7b39d8151a11 req-50298d48-51a9-4ddc-bdfb-b0bda9a03141 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033873 Sep 19 11:28:12.222139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 202/394] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:12.722463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:12.723081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:12.729983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.730751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.731211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:12.732021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.732577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.732996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:12.776017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:12.776886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:12.785500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.786696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.787448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:12.788530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:12.789250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:12.789903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:13.021937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:13.030183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-37fb06a2-750b-4ac6-9a86-1caf9844aebc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.311589 Sep 19 11:28:13.030768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 193/395] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:12 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:13.302075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:13.310180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0506b5d4-42a5-4343-876c-c8b713029619 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.540320 Sep 19 11:28:13.311189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 203/396] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:12 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:13.671597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-8b7a27ee-ffad-4f5a-9633-860eab5be2c1 req-ed7a57fd-ff57-483f-8f27-52ad2f0f7d69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8", "tag": "8c2f43fd-d3cd-4a04-b7bf-331f8fb3294a"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:13.681653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8b7a27ee-ffad-4f5a-9633-860eab5be2c1 req-ed7a57fd-ff57-483f-8f27-52ad2f0f7d69 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:13.682131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8b7a27ee-ffad-4f5a-9633-860eab5be2c1 req-ed7a57fd-ff57-483f-8f27-52ad2f0f7d69 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:13.682556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8b7a27ee-ffad-4f5a-9633-860eab5be2c1 req-ed7a57fd-ff57-483f-8f27-52ad2f0f7d69 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:13.693371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-8b7a27ee-ffad-4f5a-9633-860eab5be2c1 req-ed7a57fd-ff57-483f-8f27-52ad2f0f7d69 service nova] Creating event network-changed:8c2f43fd-d3cd-4a04-b7bf-331f8fb3294a for instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 on hv-cinder-82282 Sep 19 11:28:13.698740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-8b7a27ee-ffad-4f5a-9633-860eab5be2c1 req-ed7a57fd-ff57-483f-8f27-52ad2f0f7d69 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030719 Sep 19 11:28:13.699358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 194/397] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:14.053964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:14.055096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:14.061553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.062039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.062477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.063185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.063651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.064084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.207745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1092711733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-727516199", "security_groups": [{"name": "tempest-secgroup-smoke-1911658749"}], "networks": [{"uuid": "2e26d742-44fe-44a1-a8d1-5f4514df7454"}], "block_device_mapping_v2": [{"uuid": "7dfcd7d2-f0b1-4913-aeb1-9368c1ea3fd6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:14.209540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:14.217683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d79f18cc-cd61-4078-81e5-7eda7eb2afb8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.167496 Sep 19 11:28:14.218244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 204/398] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:14 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:14.322715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] validate_networks() for [('2e26d742-44fe-44a1-a8d1-5f4514df7454', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:28:14.333829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:14.334439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:14.342025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.342646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.343221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.344123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.344605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.345136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.521587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:14.530926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54bfdc06-2003-4923-be54-16c742c90197 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.200794 Sep 19 11:28:14.531663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 205/399] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:14 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:14.762362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:28:14.762785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:28:14.763310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:28:14.763758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:28:14.764204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:28:14.773064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.774054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.774531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.775371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:14.775823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:14.776253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:14.793612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Getting quotas for project 4f82c67c47c243f594cd2bab7ac861aa. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:28:14.798793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Getting quotas for user 792178b0829f49c2b5729aeee1805e77 and project 4f82c67c47c243f594cd2bab7ac861aa. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:28:14.859226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:28:14.861444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='7dfcd7d2-f0b1-4913-aeb1-9368c1ea3fd6',volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:28:15.242947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:15.243611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:15.250305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.250803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.251268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.251970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.252502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.252932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.277564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7b3f542d-96e3-49db-a0b4-4d54260230f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.072141 Sep 19 11:28:15.283260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 195/400] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:28:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 19 11:28:15.288354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c5563710-18f2-430e-b56d-a680ef788836 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:15.289105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c5563710-18f2-430e-b56d-a680ef788836 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:15.377573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c5563710-18f2-430e-b56d-a680ef788836 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:15.385914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c5563710-18f2-430e-b56d-a680ef788836 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1088 microversion: 2.1 time: 0.101295 Sep 19 11:28:15.386551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 196/401] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1088 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:15.442000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:15.451065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-168407bf-8390-476a-85c5-49efdb2b7462 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.212548 Sep 19 11:28:15.453690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 206/402] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:15 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:15.558846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:15.559400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:15.565725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.566216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.566653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.567382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:15.568453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:15.568453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:15.700222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:15.707815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-759652c5-162a-4373-b24e-29521114341a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.153604 Sep 19 11:28:15.708370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 197/403] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:15 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:16.408590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:16.409326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:16.416198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:16.416930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:16.417368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:16.418086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:16.418549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:16.418979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:16.474360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:16.475759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:16.484627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:16.485199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:16.485613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:16.488254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:16.488254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:16.488454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:16.488563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:16.505396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3837b99a-d811-4274-a10c-926584d2c603 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1138 microversion: 2.1 time: 0.100677 Sep 19 11:28:16.506995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 207/404] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1138 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:16.625606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:16.634400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6bb64206-f8a3-4ea2-8c17-5e3c15e9566e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.164359 Sep 19 11:28:16.634988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 198/405] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:16 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:16.731612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:16.732230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:16.738595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:16.739089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:16.739548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:16.740239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:16.740694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:16.741117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:16.885081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:16.892972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-622e891b-a103-4642-a7da-c0bc69bf5c5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.165361 Sep 19 11:28:16.893548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 208/406] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:16 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:17.529506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:17.530133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:17.536605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:17.537096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:17.540252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:17.540996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:17.541486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:17.541923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:17.608696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:17.618694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7fb85a80-e1ea-4918-a869-37509a8050bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1138 microversion: 2.1 time: 0.092658 Sep 19 11:28:17.620098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 199/407] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1138 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:17.658500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:17.659121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:17.666599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:17.668068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:17.668068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:17.668287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:17.668726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:17.669210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:17.799894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:17.808104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b4a11f41-2f64-4448-87d2-9f57765cf3d9 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.153519 Sep 19 11:28:17.808667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 209/408] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:17 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:17.916879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:17.917514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:17.923477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:17.923963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:17.924400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:17.925092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:17.925544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:17.925971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:18.058921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:18.066862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6ea8d9be-fd2a-4fe2-9574-d83f2d41ecab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.154322 Sep 19 11:28:18.067455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 200/409] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:17 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:18.643332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:18.644393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:18.645666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-086939e2-5269-4efb-972f-c7900efce52e req-216727c3-b4d1-480e-bb08-74b82b32e1d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86416d5-845e-4334-93a3-1b6702121e18", "name": "network-vif-plugged", "status": "completed", "tag": "c30d6d3a-57ad-48f7-88d3-2c6f6068da33"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:18.650676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:18.651752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=12 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:18.653642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:18.654628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:18.655295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:18.656326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:18.656950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:18.662836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:18.663426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-086939e2-5269-4efb-972f-c7900efce52e req-216727c3-b4d1-480e-bb08-74b82b32e1d0 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:18.663426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-086939e2-5269-4efb-972f-c7900efce52e req-216727c3-b4d1-480e-bb08-74b82b32e1d0 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:18.663426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-086939e2-5269-4efb-972f-c7900efce52e req-216727c3-b4d1-480e-bb08-74b82b32e1d0 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:18.672626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-086939e2-5269-4efb-972f-c7900efce52e req-216727c3-b4d1-480e-bb08-74b82b32e1d0 service nova] Creating event network-vif-plugged:c30d6d3a-57ad-48f7-88d3-2c6f6068da33 for instance d86416d5-845e-4334-93a3-1b6702121e18 on hv-cinder-82282 Sep 19 11:28:18.678290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-086939e2-5269-4efb-972f-c7900efce52e req-216727c3-b4d1-480e-bb08-74b82b32e1d0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037484 Sep 19 11:28:18.679010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 201/410] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:18.730368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:18.738278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-109b5f46-3a06-4294-829f-74c892ec8ca2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1186 microversion: 2.1 time: 0.100090 Sep 19 11:28:18.738828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 210/411] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1186 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:18.830657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:18.831311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:18.838612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:18.839127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:18.839748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:18.840456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:18.840917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:18.841381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:18.988480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:18.998643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-09461ef2-1541-42f5-895f-3025b88361a0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.172267 Sep 19 11:28:18.999469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 202/412] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:18 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:19.093502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:19.094021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:19.104340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:19.104340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:19.104340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:19.104340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:19.104704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:19.104704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:19.257568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:19.266727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ca7ee67b-63e7-452a-80e6-4f53b825167a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.180230 Sep 19 11:28:19.267341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 211/413] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:19 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:19.475769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:19.476619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:19.483354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:19.483850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:19.484286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:19.484994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:19.485443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:19.485872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:19.624580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:19.628312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:19.635583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-58c00dbf-90d9-4564-bf3f-168ca07374be tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1595 microversion: 2.1 time: 0.163175 Sep 19 11:28:19.636660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 203/414] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1595 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:19.764816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:19.766290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:19.777089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:19.778448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:19.780054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:19.781178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:19.781803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:19.782838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:19.888511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:19.897463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a946684f-84f3-4e26-8404-a4445683dd44 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1204 microversion: 2.1 time: 0.139019 Sep 19 11:28:19.904039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 212/415] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1204 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:20.023976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:20.025658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:20.033422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:20.034151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:20.034986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:20.035995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:20.036568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:20.037102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:20.269594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:20.279906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5af5848b-5532-4b5c-bfed-21fc02dd87ed tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.261541 Sep 19 11:28:20.296818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 204/416] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:20 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:20.301506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:20.302245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:20.309633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:20.310646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:20.317007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:20.332646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:20.332646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:20.332646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:20.366258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:20.559757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:20.568014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-26cf30f4-eaff-4571-afa8-1ba07457fb58 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.279368 Sep 19 11:28:20.583225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 213/417] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:20 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:20.720775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-c4dcc631-593b-4cbb-bb24-9dddb7b2f369 req-260d9740-7bd8-4423-bbf7-3e0628f444bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8", "name": "network-vif-plugged", "status": "completed", "tag": "8c2f43fd-d3cd-4a04-b7bf-331f8fb3294a"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:20.743814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-c4dcc631-593b-4cbb-bb24-9dddb7b2f369 req-260d9740-7bd8-4423-bbf7-3e0628f444bb service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:20.744324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-c4dcc631-593b-4cbb-bb24-9dddb7b2f369 req-260d9740-7bd8-4423-bbf7-3e0628f444bb service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:20.744763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-c4dcc631-593b-4cbb-bb24-9dddb7b2f369 req-260d9740-7bd8-4423-bbf7-3e0628f444bb service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:20.761940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-c4dcc631-593b-4cbb-bb24-9dddb7b2f369 req-260d9740-7bd8-4423-bbf7-3e0628f444bb service nova] Creating event network-vif-plugged:8c2f43fd-d3cd-4a04-b7bf-331f8fb3294a for instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 on hv-cinder-82282 Sep 19 11:28:20.768517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-c4dcc631-593b-4cbb-bb24-9dddb7b2f369 req-260d9740-7bd8-4423-bbf7-3e0628f444bb service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051783 Sep 19 11:28:20.769433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 205/418] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:20.921246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:20.921807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:20.929243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:20.929720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:20.931210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:20.931912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:20.932360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:20.932948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.142472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:21.151578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-586a76dc-f62f-49af-91fd-2f7e74b81869 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1272 microversion: 2.1 time: 0.234530 Sep 19 11:28:21.159552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 214/419] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1272 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:21.304201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:21.304922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:21.312282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.312779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.313495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.314393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.315004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.315753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.378430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-b9050aa3-69d3-4d5f-bbfc-2a102ab83131 req-22f07c84-79dc-4840-b97f-bb7c51731fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba241cb3-089a-4eef-a681-bddf2cb387bd", "tag": "96003a8a-4fc4-452c-bf1a-dded308d6faa"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:21.390324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-b9050aa3-69d3-4d5f-bbfc-2a102ab83131 req-22f07c84-79dc-4840-b97f-bb7c51731fc6 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.390959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-b9050aa3-69d3-4d5f-bbfc-2a102ab83131 req-22f07c84-79dc-4840-b97f-bb7c51731fc6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.391512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-b9050aa3-69d3-4d5f-bbfc-2a102ab83131 req-22f07c84-79dc-4840-b97f-bb7c51731fc6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.404124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-b9050aa3-69d3-4d5f-bbfc-2a102ab83131 req-22f07c84-79dc-4840-b97f-bb7c51731fc6 service nova] Creating event network-changed:96003a8a-4fc4-452c-bf1a-dded308d6faa for instance ba241cb3-089a-4eef-a681-bddf2cb387bd on hv-cinder-82282 Sep 19 11:28:21.425988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-b9050aa3-69d3-4d5f-bbfc-2a102ab83131 req-22f07c84-79dc-4840-b97f-bb7c51731fc6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054645 Sep 19 11:28:21.427294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 215/420] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:28:21.503783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:21.511815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-69c70cc8-5b6a-478a-9871-9aee9cbfd2cc tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.212238 Sep 19 11:28:21.512403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 206/421] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:21 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:21.594480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:21.595581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:21.602397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.603229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.603978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.604925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.605587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.606218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.866687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:21.886354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d669ab9d-332b-455e-b56f-0e763f49654d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1318 microversion: 2.1 time: 0.296921 Sep 19 11:28:21.888299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 216/422] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:21 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1318 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:21.920550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:21.921052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:21.928918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.929567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.929856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:21.931194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:21.935925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:21.936431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:22.073434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lazy-loading 'services' on Instance uuid 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:28:22.175332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:22.176152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:22.183839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:22.184340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:22.186169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:22.186169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:22.186169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:22.186542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:22.356141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3bc78e9f-d0a5-4f6c-81e4-de5c025c332c tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-volume_attachments/6c87d08a-422f-4f03-bd01-7e59cd613712" status: 202 len: 0 microversion: 2.1 time: 0.441110 Sep 19 11:28:22.356743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 207/423] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:28:21 2022] DELETE /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-volume_attachments/6c87d08a-422f-4f03-bd01-7e59cd613712 => generated 0 bytes in 443 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:28:22.530464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:22.535815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:22.537031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:22.540185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5b697dcc-387d-4939-8328-4fee4675210c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.368183 Sep 19 11:28:22.541108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 217/424] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:22.556228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:22.556718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:22.557156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:22.557891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:22.558341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:22.558793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:22.654708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-687511b4-a284-4cff-a648-3307e4944f5b req-ae3ae387-fb2f-4e6c-951d-64b3a3aeb5e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416dd466-0154-4d9a-af4a-9f87010ce3a3", "tag": "6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:22.671461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-687511b4-a284-4cff-a648-3307e4944f5b req-ae3ae387-fb2f-4e6c-951d-64b3a3aeb5e1 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:22.672009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-687511b4-a284-4cff-a648-3307e4944f5b req-ae3ae387-fb2f-4e6c-951d-64b3a3aeb5e1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:22.672370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-687511b4-a284-4cff-a648-3307e4944f5b req-ae3ae387-fb2f-4e6c-951d-64b3a3aeb5e1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:22.683939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-687511b4-a284-4cff-a648-3307e4944f5b req-ae3ae387-fb2f-4e6c-951d-64b3a3aeb5e1 service nova] Creating event network-changed:6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 for instance 416dd466-0154-4d9a-af4a-9f87010ce3a3 on hv-cinder-82282 Sep 19 11:28:22.689324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-687511b4-a284-4cff-a648-3307e4944f5b req-ae3ae387-fb2f-4e6c-951d-64b3a3aeb5e1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041862 Sep 19 11:28:22.689979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 218/425] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:28:22.718234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:22.726344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-310c5035-1bb3-4513-9654-261eadb9e21d tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1314 microversion: 2.1 time: 0.194711 Sep 19 11:28:22.727140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 208/426] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:22 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1314 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:22.918010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:22.918010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:22.923906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:22.923906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:22.923906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:22.923906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:22.924475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:22.924475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.093137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:23.101344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6e856490-93cb-4468-a91e-362c820f70c3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1507 microversion: 2.1 time: 0.194370 Sep 19 11:28:23.111658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 219/427] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:22 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1507 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:23.563583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:23.564888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:23.571924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.572723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.573369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.574322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.574864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.575620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.740955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:23.749309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-768c6a73-85a2-4f50-b1c6-656460540f3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.189457 Sep 19 11:28:23.749895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 209/428] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:23.750923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:23.751584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:23.758070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.759152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.759957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.760707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.761161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.761579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.896644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:23.909200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1dfd6394-2d6b-404e-aef0-a5ac09aab9ce tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1463 microversion: 2.1 time: 0.158348 Sep 19 11:28:23.909200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 220/429] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:23 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1463 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:23.956051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:23.956664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:23.963623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.964109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.964542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.965237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:23.965689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:23.966117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:23.992107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:28:24.375212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-191422cc-7438-43e9-bd20-8eefdd00dbbd tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "DELETE /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 204 len: 0 microversion: 2.1 time: 0.422612 Sep 19 11:28:24.375994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 210/430] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:28:23 2022] DELETE /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:28:24.384785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:24.385547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:24.393624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:24.394308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:24.395142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:24.396095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:24.396823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:24.397257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:24.535882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:24.544742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bfbcdebf-024f-4abd-96bd-88f37606dae0 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1469 microversion: 2.1 time: 0.164167 Sep 19 11:28:24.545737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 221/431] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:24 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:24.773344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:24.778440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:24.781208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:24.781714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:24.782151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:24.782871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:24.783385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:24.784074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:24.784664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:24.920773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:24.930473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-74654d3d-ab38-43d5-a8d8-0b7444f01928 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.161245 Sep 19 11:28:24.931074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 211/432] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:25.569162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:25.569921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:25.580330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.580998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.581730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.582184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.582772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.583058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.613456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a7374ce7-2123-4246-87dc-f77e4d99e3a0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:25.615434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=16 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:25.623001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7374ce7-2123-4246-87dc-f77e4d99e3a0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.623544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7374ce7-2123-4246-87dc-f77e4d99e3a0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.623978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7374ce7-2123-4246-87dc-f77e4d99e3a0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.686157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a7374ce7-2123-4246-87dc-f77e4d99e3a0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Going to try to stop instance {{(pid=121084) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 19 11:28:25.740983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:25.749740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b15b3282-cc18-4a23-88dc-32cc2d48c2f8 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1469 microversion: 2.1 time: 0.184464 Sep 19 11:28:25.750387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 222/433] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:25 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:25.755403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1365930836"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:25.755940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:25.762695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.763221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.763668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.764387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.764846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.765649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.858369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a7374ce7-2123-4246-87dc-f77e4d99e3a0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action" status: 202 len: 0 microversion: 2.1 time: 0.248636 Sep 19 11:28:25.859157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 212/434] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:28:25 2022] POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:28:25.867733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:25.868508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:25.875832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.876240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.876677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.877378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:25.877840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:25.878268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:25.917629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.network.security_group_api [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Adding security group f77d1d69-a1db-4e23-a349-ca49f9c16007 to port 6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 Sep 19 11:28:26.094557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:26.103604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-853247c4-d8e5-4058-810f-7a2327efd826 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1721 microversion: 2.1 time: 0.240112 Sep 19 11:28:26.105577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 213/435] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:25 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1721 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:26.110332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:26.111192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:26.117537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.118244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.118891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.119843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.120457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.121050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.353430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:26.366229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4a201cae-3513-4ed9-8d61-9e82db159b83 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.259367 Sep 19 11:28:26.366810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 214/436] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:26.527111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d09451e9-8957-44a0-b2c9-9bd623b30d6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action" status: 202 len: 0 microversion: 2.1 time: 0.775393 Sep 19 11:28:26.528079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 223/437] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:28:25 2022] POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action => generated 0 bytes in 777 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:28:26.539345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:26.540277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:26.547753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.549070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.549783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.551121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.552268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.552869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.569257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-f2b98d7a-7dc7-4554-ae85-1f1fd980d18a req-b637fe3a-1672-4d36-b078-7dda74a7ebcf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416dd466-0154-4d9a-af4a-9f87010ce3a3", "tag": "6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:26.586765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-f2b98d7a-7dc7-4554-ae85-1f1fd980d18a req-b637fe3a-1672-4d36-b078-7dda74a7ebcf service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.587284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-f2b98d7a-7dc7-4554-ae85-1f1fd980d18a req-b637fe3a-1672-4d36-b078-7dda74a7ebcf service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.587753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-f2b98d7a-7dc7-4554-ae85-1f1fd980d18a req-b637fe3a-1672-4d36-b078-7dda74a7ebcf service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.613914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-f2b98d7a-7dc7-4554-ae85-1f1fd980d18a req-b637fe3a-1672-4d36-b078-7dda74a7ebcf service nova] Creating event network-changed:6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 for instance 416dd466-0154-4d9a-af4a-9f87010ce3a3 on hv-cinder-82282 Sep 19 11:28:26.619795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-f2b98d7a-7dc7-4554-ae85-1f1fd980d18a req-b637fe3a-1672-4d36-b078-7dda74a7ebcf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054660 Sep 19 11:28:26.622309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 224/438] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:28:26.809368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:26.819669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f80db5f2-b1fb-4ab8-a8f1-fe013f97b6c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1760 microversion: 2.1 time: 0.286551 Sep 19 11:28:26.820671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 215/439] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1760 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:26.835267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:26.836736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:26.847141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.852980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.852980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:26.852980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:26.852980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:26.853983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.093219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-8dc42a50-5ecb-4255-81af-ae346d8cc0cd req-87406829-5472-4193-814b-68ffb3f207e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8", "name": "network-vif-deleted", "tag": "8c2f43fd-d3cd-4a04-b7bf-331f8fb3294a"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:27.108982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8dc42a50-5ecb-4255-81af-ae346d8cc0cd req-87406829-5472-4193-814b-68ffb3f207e9 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.109409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8dc42a50-5ecb-4255-81af-ae346d8cc0cd req-87406829-5472-4193-814b-68ffb3f207e9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.109916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8dc42a50-5ecb-4255-81af-ae346d8cc0cd req-87406829-5472-4193-814b-68ffb3f207e9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.144501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-8dc42a50-5ecb-4255-81af-ae346d8cc0cd req-87406829-5472-4193-814b-68ffb3f207e9 service nova] Creating event network-vif-deleted:8c2f43fd-d3cd-4a04-b7bf-331f8fb3294a for instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 on hv-cinder-82282 Sep 19 11:28:27.150581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-8dc42a50-5ecb-4255-81af-ae346d8cc0cd req-87406829-5472-4193-814b-68ffb3f207e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065747 Sep 19 11:28:27.158080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 216/440] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:27.163668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:27.164761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:27.165783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:27.172599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.173383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.174070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.175240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.176134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.176642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-878315cc-85a9-4402-974d-e4d59de31bfb tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1469 microversion: 2.1 time: 0.345763 Sep 19 11:28:27.176980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.181136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 225/441] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:26 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1469 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:27.390872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:27.391529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:27.397875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.398539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.401875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.401875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:27.401875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:27.401875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:27.467028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:27.474890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-359884df-c653-404f-865d-dfc51288ba42 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.321549 Sep 19 11:28:27.487195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 217/442] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:27 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:27.653511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:27.667206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ffce98e9-2b57-4c97-ade2-f3d54cae3505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.280973 Sep 19 11:28:27.667769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 226/443] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:28.205765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:28.206490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:28.213408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:28.213893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:28.214331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.215029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:28.215532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:28.215971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.235092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:28.249647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:28.250138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:28.250580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.251029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lazy-loading 'fault' on Instance uuid 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:28:28.293891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4ef532361ce8429ea43232ee36d1a3d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0874e13ae9984c9fbcedb57f7717a73c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:28.301799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0b15b2c7-f453-48d6-8df1-597dc7ca3fd6 tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 200 len: 1304 microversion: 2.1 time: 0.099922 Sep 19 11:28:28.302445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 218/444] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:28 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:28.501432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:28.502046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:28.508162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:28.508651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:28.509088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.509776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:28.510237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:28.510664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.647398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:28.655770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8f528eba-be2d-4c9c-b1f7-45ffb6f5051a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.158595 Sep 19 11:28:28.656485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 227/445] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:28 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:28.691323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:28.691935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:28.699545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:28.700025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:28.700458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.701270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:28.701689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:28.702117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:28.836373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:28.844341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6419362e-a942-4161-a57f-5ab34b27554c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.156968 Sep 19 11:28:28.844927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 219/446] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:29.326687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:29.327440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] [instance: 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:29.333996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.334491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.334932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.335964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.336425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.336852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.361018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] HTTP exception thrown: Instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 could not be found. Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Request method failure captured: Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 HTTP/1.1 Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFJF7qrGEZovUsfFAy5qCZU7M7_RDgEPgbiIpxXefSQfH-2Js4LYEj_4iktiFJSLqun4MnXtGO3GlY6kywCmETD0KRJF8V-qO-QyLghMIulzi22hKmp1DDV20puKVjXQtrudbskqi-SqpGRKhvHwHrHilJ-mP028vJPNX_AGODJ1ghg Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 0874e13ae9984c9fbcedb57f7717a73c Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesNegativeTest-363274770 Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:28:29.362773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0874e13ae9984c9fbcedb57f7717a73c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0874e13ae9984c9fbcedb57f7717a73c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0874e13ae9984c9fbcedb57f7717a73c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0874e13ae9984c9fbcedb57f7717a73c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesNegativeTest-363274770 Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 0874e13ae9984c9fbcedb57f7717a73c Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesNegativeTest-363274770 Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesNegativeTest-363274770-project Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4ef532361ce8429ea43232ee36d1a3d4 Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesNegativeTest-363274770-project Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 could not be found. Sep 19 11:28:29.364502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8'} Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 could not be found. Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:28:29.365343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 could not be found. Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 could not be found. Sep 19 11:28:29.366609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:28:29.367871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] Returning 404 to user: Instance 5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:28:29.367871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-acc7655e-d2fd-4d0c-996c-c9596d77990e tempest-VolumesNegativeTest-363274770 tempest-VolumesNegativeTest-363274770-project] 10.222.0.78 "GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8" status: 404 len: 111 microversion: 2.1 time: 0.042516 Sep 19 11:28:29.367871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 228/447] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:29 2022] GET /compute/v2.1/servers/5fa3f806-fa9d-4f9d-922d-fc7f61f2b2c8 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:28:29.679875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:29.680762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:29.689075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.689570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.690045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.690835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.691330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.691770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.826079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:29.833744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-832f0c19-4312-44f9-8796-e5084b1f0fc1 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.157790 Sep 19 11:28:29.834316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 220/448] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:29 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:29.866985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:29.867621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:29.874353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.874959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.875372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:29.876159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:29.876658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:29.877067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.030144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:30.038465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ea1727b5-df6b-4f8a-b563-937beae427ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.175207 Sep 19 11:28:30.039053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 229/449] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:30.161748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:30.162801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:30.168866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.170074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.170517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.171267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.171744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.172171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.197540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4082e4da-e690-4fd6-ba3e-ec639b162f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/ips" status: 200 len: 152 microversion: 2.20 time: 0.040479 Sep 19 11:28:30.198728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 221/450] 10.222.0.78 () {60 vars in 1289 bytes} [Mon Sep 19 11:28:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:28:30.858656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:30.859444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:30.865677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.866454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.867386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:30.868184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:30.868810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:30.869391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:31.032733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:31.044722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-18113d85-618e-4d5d-892b-0a903825ea23 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.187151 Sep 19 11:28:31.044722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 230/451] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:30 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:31.065839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:31.067021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:31.076130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:31.082906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:31.082906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:31.082906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:31.082906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:31.083557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:31.226098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:31.234303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4b0fde8e-6cde-4a9b-8a6d-8eb4eb4d0fd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.175985 Sep 19 11:28:31.234898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 222/452] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:32.069078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:32.069708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:32.077731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.077731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.079154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.079154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.079699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.080085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.212582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:32.220458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-29d9b18a-f558-402b-9f63-44ad31a96917 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.155187 Sep 19 11:28:32.221087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 231/453] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:32 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:32.256878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:32.257496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:32.264456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.265080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.265738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.266707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:32.267406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:32.267876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:32.425101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:32.434186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3105c1ce-4678-4c15-80ab-6a510a16e6f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.181054 Sep 19 11:28:32.434953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 223/454] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:33.110014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:33.111094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:33.126884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.127581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.128334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.129629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.130096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.130619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.156538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lazy-loading 'flavor' on Instance uuid e7226154-6dfa-424f-b89e-fb320490d32c {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:28:33.177595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:33.246306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:33.246999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:33.255680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.256209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.256670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.257460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.257995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.258452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.417003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.430478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-296b5e35-3c66-4677-a1e2-ebbb53edf072 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.188471 Sep 19 11:28:33.448012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 224/455] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:33 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:33.461366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:33.462356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:33.470404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.471066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.471696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.472616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.476745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.476745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.624831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.633074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e2de9a3a-5a4a-4a98-b7e9-19db4757d4b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.179471 Sep 19 11:28:33.633836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 225/456] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:33.722968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-20650fc3-74c1-4fc5-b855-970dfb2b53c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/action" status: 202 len: 0 microversion: 2.20 time: 0.618069 Sep 19 11:28:33.725095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 232/457] 10.222.0.78 () {62 vars in 1319 bytes} [Mon Sep 19 11:28:33 2022] POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/action => generated 0 bytes in 620 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:28:33.733716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:33.734516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:33.742056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.742651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.743074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.745119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:33.745606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:33.750462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:33.891516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.901990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.904217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:33.905216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e336a75d-c403-429d-a035-e926be2a76d8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.176752 Sep 19 11:28:33.905786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 226/458] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:34.469086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:34.469795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:34.478938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.479472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.479925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.480624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.481082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.481510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.620572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:34.629471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-57f902ef-21fc-4e58-827f-46b0b1d52141 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.165720 Sep 19 11:28:34.630047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 233/459] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:34 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:34.656552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:34.657256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:34.663440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.663928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.664368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.665065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.665524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.665955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.814121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:34.825044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-61e89968-a967-4177-923f-23c90aa80677 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.171934 Sep 19 11:28:34.825044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 227/460] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:34.932159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:34.932704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:34.934745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:34.940489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.940990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.941434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:34.942278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:34.942743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:34.943192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:35.082053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:35.090806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:35.092319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:35.093711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bada39f4-18ba-491d-a475-f5eee8686b26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.165649 Sep 19 11:28:35.094401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 234/461] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:35.654251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:35.654940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:35.661946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:35.662815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:35.662962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:35.663599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:35.664054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:35.664482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:35.809295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:35.817538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-509eeee0-20ba-482c-a0ed-c7bc94cf71da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.167593 Sep 19 11:28:35.818133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 228/462] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:35 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:35.855844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:35.855844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:35.857299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:35.857617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:35.858049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:35.858784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:35.861999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:35.862515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:36.006660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:36.014822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8a037825-f07f-4427-bafe-6c6d6994cc74 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.168817 Sep 19 11:28:36.015642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 235/463] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:36.120485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:36.121173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:36.124161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:36.127603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:36.128305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:36.128900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:36.129605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:36.130218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:36.130794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:36.264592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:36.272861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:36.274306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:36.275499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a760cf14-b308-4eea-b00b-8a733a4c5dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.159252 Sep 19 11:28:36.276061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 229/464] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:36.700876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-ea4c1984-04d0-4c8f-829f-1a07ac9d03ff req-e722e4dc-4a30-40eb-823a-5b6aa144d668 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba241cb3-089a-4eef-a681-bddf2cb387bd", "name": "network-vif-plugged", "status": "completed", "tag": "96003a8a-4fc4-452c-bf1a-dded308d6faa"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:36.713469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ea4c1984-04d0-4c8f-829f-1a07ac9d03ff req-e722e4dc-4a30-40eb-823a-5b6aa144d668 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:36.714086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ea4c1984-04d0-4c8f-829f-1a07ac9d03ff req-e722e4dc-4a30-40eb-823a-5b6aa144d668 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:36.714760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ea4c1984-04d0-4c8f-829f-1a07ac9d03ff req-e722e4dc-4a30-40eb-823a-5b6aa144d668 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:36.729969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-ea4c1984-04d0-4c8f-829f-1a07ac9d03ff req-e722e4dc-4a30-40eb-823a-5b6aa144d668 service nova] Creating event network-vif-plugged:96003a8a-4fc4-452c-bf1a-dded308d6faa for instance ba241cb3-089a-4eef-a681-bddf2cb387bd on hv-cinder-82282 Sep 19 11:28:36.737833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-ea4c1984-04d0-4c8f-829f-1a07ac9d03ff req-e722e4dc-4a30-40eb-823a-5b6aa144d668 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041227 Sep 19 11:28:36.738391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 236/465] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:28:36.843081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:36.843700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:36.850473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:36.850965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:36.851562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:36.852264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:36.852721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:36.853144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:36.998937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.007539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d80d9dfe-689d-4a3a-be01-4a9eef0c2b4d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.168661 Sep 19 11:28:37.007860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 230/466] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:36 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:37.038919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:37.039758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:37.047313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:37.047794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:37.048224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:37.048915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:37.049364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:37.049783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:37.165206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e87eab9-86a5-41eb-8b1f-661c41a31725"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:37.168216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:37.175338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:37.176896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:37.176896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:37.177109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:37.177447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:37.177880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:37.239576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.249573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-38916301-c384-42d3-af08-d78b944accc2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.215797 Sep 19 11:28:37.250234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 237/467] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:37.302724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:37.303484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:37.309387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:37.309965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:37.310398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:37.311081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:37.311558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:37.312025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:37.446115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.454627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.456121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:37.457304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d3eff99a-2ed8-4acf-9336-cb49ed2e936c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.158539 Sep 19 11:28:37.457863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 238/468] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:38.030746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:38.035428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:38.037731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.038263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.038710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.039517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.040095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.040414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.173317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.181153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-67798ba5-8c18-48ec-a0bd-a8b6f98e7440 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.154433 Sep 19 11:28:38.181729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 239/469] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:38 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:38.196643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-46e358cf-c68e-408c-862d-00671b45dcab tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.036309 Sep 19 11:28:38.197505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 231/470] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 11:28:37 2022] POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 194 bytes in 1038 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:28:38.272443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:38.275379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:38.279200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.279631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.280068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.280822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.281275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.281699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.422424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.428174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b940f70-1763-4b7c-b81f-dd67224b7cb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1260 microversion: 2.1 time: 0.159542 Sep 19 11:28:38.428781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 240/471] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1260 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:38.484478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:38.487408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:38.491382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.491871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.492345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.493039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:38.493499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:38.493924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:38.625464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.634541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.636069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:38.637236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4845fd18-2e5d-4185-9670-5b2d2cd43c56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.157869 Sep 19 11:28:38.637801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 232/472] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:39.206596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:39.207226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:39.213894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.214395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.214835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.215585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.216048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.216477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.358526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.366644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3bb21df6-027a-4c16-8044-954fdc513840 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.164837 Sep 19 11:28:39.367243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 241/473] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:39 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:39.451716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:39.452307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:39.458817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.459280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.459717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.460667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.461117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.461539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.592364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.595873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:39.600506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70cd32db-03c2-4f32-9923-8f3ed25f7d9e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1444 microversion: 2.1 time: 0.152731 Sep 19 11:28:39.601079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 233/474] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1444 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:39.625006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:39.625819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:39.631786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.632260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.632689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.633373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.633822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.634239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.662754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:39.663534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:39.670092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.671064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.677445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.677445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:39.677445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:39.677445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:39.816972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.825028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8bfd58bf-37d9-497d-8906-3ec3fb0cd6db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1444 microversion: 2.1 time: 0.204842 Sep 19 11:28:39.825608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 242/475] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1444 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:39.846455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.855219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.856538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:39.857696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf4e40fe-2ed6-40ee-b73e-c147c9090781 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.199237 Sep 19 11:28:39.858917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 234/476] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:40.391110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:40.391761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:40.400113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:40.400854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:40.401471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:40.402248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:40.402713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:40.403154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:40.543505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:40.551330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0dacdfcd-aff5-48ac-a889-7d81764ae194 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.164778 Sep 19 11:28:40.551993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 243/477] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:40 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:40.883807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:40.884436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:40.891399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:40.891877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:40.892336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:40.892986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:40.893432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:40.893850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:41.039221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:41.047909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:41.049355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:41.050513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6cd60750-590a-45fa-b747-33733ba52dd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.170672 Sep 19 11:28:41.051081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 235/478] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:41.575242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:41.575955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:41.583004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:41.583550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:41.583980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:41.584669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:41.585121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:41.585799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:41.716189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:41.724076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7d354d06-cf63-4852-9a90-365e542953c3 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1675 microversion: 2.1 time: 0.152698 Sep 19 11:28:41.724646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 244/479] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:41 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:42.081903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:42.082507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:42.089779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:42.090257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:42.090689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:42.091454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:42.091901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:42.092835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:42.229411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:42.241480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:42.243313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:42.244612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eebde1ea-587f-4203-9363-88f2fd60af8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.166544 Sep 19 11:28:42.245186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 236/480] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:42.283331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-cebaa74d-6ff8-4a8e-9e8a-dd838861ac77 req-dcd38495-a4da-41b0-84fe-5f078bcaf9ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba241cb3-089a-4eef-a681-bddf2cb387bd", "tag": "96003a8a-4fc4-452c-bf1a-dded308d6faa"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:42.293153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-cebaa74d-6ff8-4a8e-9e8a-dd838861ac77 req-dcd38495-a4da-41b0-84fe-5f078bcaf9ad service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:42.293618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-cebaa74d-6ff8-4a8e-9e8a-dd838861ac77 req-dcd38495-a4da-41b0-84fe-5f078bcaf9ad service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:42.294123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-cebaa74d-6ff8-4a8e-9e8a-dd838861ac77 req-dcd38495-a4da-41b0-84fe-5f078bcaf9ad service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:42.306781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-cebaa74d-6ff8-4a8e-9e8a-dd838861ac77 req-dcd38495-a4da-41b0-84fe-5f078bcaf9ad service nova] Creating event network-changed:96003a8a-4fc4-452c-bf1a-dded308d6faa for instance ba241cb3-089a-4eef-a681-bddf2cb387bd on hv-cinder-82282 Sep 19 11:28:42.312212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-cebaa74d-6ff8-4a8e-9e8a-dd838861ac77 req-dcd38495-a4da-41b0-84fe-5f078bcaf9ad service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033429 Sep 19 11:28:42.312913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 245/481] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:28:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:28:42.748065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:42.749483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:42.756292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:42.756886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:42.757517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:42.758440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:42.758902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:42.761391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.123326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a9f1e9fc-2c2e-42fc-b4ac-19ff2270242e", "device": "/dev/sdb"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:43.126194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:43.135700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:43.136643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:43.137714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.139576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:43.140442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:43.141289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.211935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:43.221377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-50447256-64fc-4833-b987-2804cdaf5514 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1652 microversion: 2.1 time: 0.477116 Sep 19 11:28:43.221965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 237/482] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:42 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1652 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:43.245785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8b6830c6-be76-4144-a299-af6119c3aaa8 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:43.253235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b6830c6-be76-4144-a299-af6119c3aaa8 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:43.253734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b6830c6-be76-4144-a299-af6119c3aaa8 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:43.254169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b6830c6-be76-4144-a299-af6119c3aaa8 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.281619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8b6830c6-be76-4144-a299-af6119c3aaa8 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Going to try to start instance {{(pid=121084) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 19 11:28:43.441360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8b6830c6-be76-4144-a299-af6119c3aaa8 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action" status: 202 len: 0 microversion: 2.1 time: 0.199185 Sep 19 11:28:43.442577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 238/483] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:28:43 2022] POST /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:28:43.448302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:43.449005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:43.455660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:43.456150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:43.456582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.457270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:43.457721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:43.458140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.593589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:43.603106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:43.604588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:43.605766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8935e447-cb1e-4f7b-bf84-532d65b399b0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.162486 Sep 19 11:28:43.606335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 239/484] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:43.612867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:43.617086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:43.620648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:43.621253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:43.621838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.622640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:43.623951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:43.624556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:43.808877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:43.817101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4f997803-aeb6-4a93-a99a-556c9b9c64e2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1661 microversion: 2.1 time: 0.208548 Sep 19 11:28:43.817687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 240/485] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:43 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1661 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:43.967586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7079e797-bff8-41fa-8282-fd481e111c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "POST /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.851503 Sep 19 11:28:43.968206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 246/486] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 11:28:43 2022] POST /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18/os-volume_attachments => generated 194 bytes in 853 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:28:44.633044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:44.633657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:44.640586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.641069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.641510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.642204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.642662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.643092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.770720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.778904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.781000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.782158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1b086149-75ed-45f5-a67b-d487d8123ee6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.153079 Sep 19 11:28:44.782725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 241/487] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:44.842253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:44.843551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:44.849844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.850329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.850766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.851491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:44.851945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:44.852370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:44.981540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:44.985098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:44.989702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-224bb388-36b2-4bda-bb62-66bd0d0136c9 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1661 microversion: 2.1 time: 0.152420 Sep 19 11:28:44.990273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 247/488] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:44 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1661 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:45.807624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:45.808222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:45.814772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:45.815282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:45.815716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:45.816400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:45.816848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:45.817269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:45.950407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:45.959760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:45.961519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:45.962863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-be8eccf6-6fec-4bf3-bc53-182afe2d3900 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.159151 Sep 19 11:28:45.963460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 242/489] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:46.013678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:46.014289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:46.021398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.021880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.022315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:46.023004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.023488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.023918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:46.159437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:46.167444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b74a9b33-f28a-4166-91de-f962b3d71376 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1665 microversion: 2.1 time: 0.157915 Sep 19 11:28:46.170739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 248/490] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:46 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1665 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:46.989548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:46.990159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:46.996674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.997158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.997679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:46.998410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:46.998869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:46.999335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:47.138968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:47.147136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:47.148573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:47.149871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-685f517a-2a5d-49c6-942a-3f6e239c5818 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.164570 Sep 19 11:28:47.150302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 243/491] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:47.876876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:28:47.879154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:47.885755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:47.886233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:47.886664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:47.887391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:47.887863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:47.888283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:47.912086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lazy-loading 'flavor' on Instance uuid c3837b49-df54-4e20-a19e-5be03f339e84 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:28:48.175615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:48.176286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:48.183233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.183807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.184250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.184979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.186033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.186033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.278036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a2f7de4d-97bc-44dd-944a-8ea0b57d350a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/action" status: 200 len: 32 microversion: 2.1 time: 0.394184 Sep 19 11:28:48.278036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 249/492] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:28:47 2022] POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/action => generated 32 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:28:48.284175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:48.285118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:48.291795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.294301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.294301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.294301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:48.294301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:48.294733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:48.333403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.341913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.343462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.344627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b2835be1-e85a-4ead-a9df-937673183128 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.173185 Sep 19 11:28:48.345182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 244/493] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:28:48.468918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:48.475721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3062ae2e-fb0c-4d37-85df-39b5515d7404 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.195757 Sep 19 11:28:48.476314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 250/494] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:49.369903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:49.370510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:49.377884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.378362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.378795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.379527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.379980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.380410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.499404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:49.500098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:49.506544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.507033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.507540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.507961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.508225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:49.508684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:49.509116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:49.516497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.517937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.519124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1b51abd0-5b1b-40de-9b3c-a4b6a3d41d01 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.153169 Sep 19 11:28:49.519707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 245/495] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:49.636585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:49.644885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f842f3da-197a-45e7-ba16-8e99a1b180a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.149431 Sep 19 11:28:49.645457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 251/496] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:50.544817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:50.545414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:50.551784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.552259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.552689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.553365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.553811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.554229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.668765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:50.669405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:50.676892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.677385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.677858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.678574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:50.679032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:50.679562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:50.687601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.700665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.702131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.703332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9b2b3790-6d33-4000-a91b-d6804dec2df0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.162372 Sep 19 11:28:50.703896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 246/497] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:50.816712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:50.825016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1546dc11-299d-4f09-a557-66923a12401c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.160150 Sep 19 11:28:50.825587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 252/498] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:51.729747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:51.730285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:51.737132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.737616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.738051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.738755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.739237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.739669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.848742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:51.849348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:51.855802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.856284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.856709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.857410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:51.857871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:51.858295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:51.873252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:51.881868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:51.883366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:51.884552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b5c3cbf3-14b8-436e-9567-66d3d83f4d7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.158876 Sep 19 11:28:51.885314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 247/499] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:51.992973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:52.001790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-05c28e0d-caf5-483b-8a3b-3a3858551ef2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.156925 Sep 19 11:28:52.003748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 253/500] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:52.910023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:52.910572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:52.917112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:52.917593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:52.918035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:52.918721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:52.919198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:52.919624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.025811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:53.026419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:53.032898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:53.033388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:53.033833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.034534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:53.034993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:53.035453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:53.054558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.062584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.064661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.065875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2807700c-be56-4162-bba4-8eae965b2698 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.159868 Sep 19 11:28:53.066727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 248/501] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:53.170761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:53.179760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8f9e62ac-7b9a-4cb7-803d-0b1927289398 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.157810 Sep 19 11:28:53.180352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 254/502] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:54.091139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:54.091815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:54.098359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.098875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.099285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.100033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.100491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.100913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.119861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:28:54.204203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:54.205441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:54.212404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.212887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.213328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.214011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:54.214465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:54.214884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:54.234969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.243609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.245166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.246679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-56da11eb-0a35-44a5-8d22-f88c3208e9a0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.159470 Sep 19 11:28:54.247432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 249/503] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:54.350014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:54.358451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a60f5f5-87a5-4715-b7f4-96985f59ae40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.158020 Sep 19 11:28:54.359024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 255/504] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:28:55.273375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:55.273988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:55.281153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.281643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.282084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.283417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.283879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.284312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.382705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:55.383516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:55.390685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.391595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.393023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.394072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:55.394541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:55.394982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:55.424888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.433440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.434879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.436075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e1294fce-7674-46a3-bc58-4e3b2ea88779 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.166820 Sep 19 11:28:55.436627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 250/505] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:55.535413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:55.543975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b3facb7e-78f6-4d96-9389-dad841474673 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.165904 Sep 19 11:28:55.544561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 256/506] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:56.462595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:56.463146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:56.469560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.470032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.470457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.471133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.471615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.472020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.570193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:56.570193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:56.575818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.576316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.576764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.577491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:56.577936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:56.578368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:56.602709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.611716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.613193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.614355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6b4f3121-4752-47de-b883-2f68ba313950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.156013 Sep 19 11:28:56.614915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 251/507] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:56.707824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:56.716621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a92455e4-5bd2-4b9c-bc29-cd480f56700e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.152686 Sep 19 11:28:56.717596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 257/508] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:57.639481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:57.640075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:57.646417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.646893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.647353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.648035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.648477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.648897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.740550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:57.741272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:57.747856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.748429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.748941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.749769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:57.750309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:57.750809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:57.783922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.792474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.793846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.795031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3523396-acda-4b81-809b-93ca532cf6fa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.159456 Sep 19 11:28:57.795656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 252/509] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:57.880323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:57.888441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a16ec035-1352-420b-b3b7-20b4fbdb4503 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.152328 Sep 19 11:28:57.889003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 258/510] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:28:58.821915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:58.822622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:58.829252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.829733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.830207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:58.830907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.831393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.831821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:58.911491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:28:58.912115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:28:58.918771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.919285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.919726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:58.920421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:28:58.920872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:28:58.921295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:28:59.085224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.093572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.095073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.096266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-435d7ce6-31da-40bf-bd49-fd3834165371 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1725 microversion: 2.20 time: 0.278343 Sep 19 11:28:59.097024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 253/511] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:28:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1725 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:28:59.121615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:28:59.130547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fa24e5aa-7899-4667-ae79-f0a06825d69e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.223038 Sep 19 11:28:59.131126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 259/512] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:28:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:00.123375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:00.124076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:00.131081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.131594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.132026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.132748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.133189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.133606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.153933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:00.154546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:00.161174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.161671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.162116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.162810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:00.163298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:00.163726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:00.334259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.341563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.343239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.344766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:00.346042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f3e2c3e9-11bf-4491-8618-35607723f67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1746 microversion: 2.20 time: 0.226956 Sep 19 11:29:00.346688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 254/513] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1746 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:00.349851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-98870f26-e47e-4280-b4d4-3cec8afb4cb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.199965 Sep 19 11:29:00.350419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 260/514] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:01.372464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:01.373076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:01.373182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:01.379965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:01.380270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.380270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.380706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.381450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.381728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.381899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.382326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.382558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.383363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.384089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:01.385057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:01.385657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:01.583066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.590977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.591717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.593161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:01.594349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-364dccae-7fa5-44b0-a6c6-e315afb4fc75 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1746 microversion: 2.20 time: 0.225763 Sep 19 11:29:01.594950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 255/515] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1746 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:01.599665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-789ea954-1f15-483a-9899-5c5786673a5d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.230303 Sep 19 11:29:01.600324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 261/516] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:02.620975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:02.621569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:02.623350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:02.623992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:02.628090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.628579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.629019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:02.629716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.630173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.630600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:02.630709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.631074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.631546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:02.632233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:02.632682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:02.633116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:02.651760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:02.826350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:02.831273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:02.835632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:02.837082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:02.838288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-55a88c29-b456-4917-a8c4-096a9785c5a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1746 microversion: 2.20 time: 0.222272 Sep 19 11:29:02.838853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 256/517] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1746 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:02.840100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-af6d5c41-8b80-4ee0-8862-4a67596831b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.220477 Sep 19 11:29:02.840669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 262/518] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:03.863863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:03.864623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:03.866105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:03.867343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:03.871531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:03.872138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:03.872449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:03.873144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:03.873593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:03.874018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:03.874333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:03.874924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:03.875554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:03.876489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:03.877843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:03.878283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:04.076756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:04.079939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:04.089008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:04.089264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c14b9fdc-4aa7-4317-8c88-e8bd7a1c5078 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.229064 Sep 19 11:29:04.089909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 257/519] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:04.090556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:04.091915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-649bc155-290e-4ab4-8de0-fdef77ca7cf1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1746 microversion: 2.20 time: 0.230555 Sep 19 11:29:04.092474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 263/520] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1746 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:04.730427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-c662f437-0948-4cba-ad4e-4f72836c3fd9 req-52d1b8a8-fd55-4336-bba8-ae030fb2b0ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "name": "network-vif-plugged", "status": "completed", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:04.740069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-c662f437-0948-4cba-ad4e-4f72836c3fd9 req-52d1b8a8-fd55-4336-bba8-ae030fb2b0ed service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:04.740546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-c662f437-0948-4cba-ad4e-4f72836c3fd9 req-52d1b8a8-fd55-4336-bba8-ae030fb2b0ed service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:04.740980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-c662f437-0948-4cba-ad4e-4f72836c3fd9 req-52d1b8a8-fd55-4336-bba8-ae030fb2b0ed service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:04.752542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-c662f437-0948-4cba-ad4e-4f72836c3fd9 req-52d1b8a8-fd55-4336-bba8-ae030fb2b0ed service nova] Creating event network-vif-plugged:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 11:29:04.757729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-c662f437-0948-4cba-ad4e-4f72836c3fd9 req-52d1b8a8-fd55-4336-bba8-ae030fb2b0ed service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030986 Sep 19 11:29:04.758312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 258/521] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:05.112600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:05.113224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:05.115524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=60 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:05.120293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.120784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.121228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.121977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.122442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.122868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.125832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:05.126527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:05.132648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.133129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.133573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.134264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:05.134746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:05.135189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:05.319161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.322516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.327789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-440dadc8-d59c-45fe-bfa9-dff975edd8dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.219159 Sep 19 11:29:05.328366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 264/522] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:05.331665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.333113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:05.334270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d07da0b-fd78-4de9-b77b-85f8a45b2c4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1746 microversion: 2.20 time: 0.213320 Sep 19 11:29:05.335078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 259/523] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1746 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:06.353123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:06.363216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:06.363358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:06.363358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:06.363899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.363899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.363899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.363899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.364209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.364209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.367027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.367556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.367994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.368754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.369154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.369586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.575334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.582926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.584957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-21b3a2ef-85e9-427a-8423-194492cc5973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.235418 Sep 19 11:29:06.585553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 265/524] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:06.592451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.593881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:06.595316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-79f28b0a-4310-4ab9-bbd7-1ab12ee5529a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1746 microversion: 2.20 time: 0.239284 Sep 19 11:29:06.596366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 260/525] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1746 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:06.603004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:06.605343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:06.614579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.615102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.615529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.616226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.616680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.617096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.959985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b7455501-4b71-438d-8299-336b248e0439 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action" status: 202 len: 0 microversion: 2.1 time: 0.366067 Sep 19 11:29:06.960796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 266/526] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:29:06 2022] POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:06.968689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:06.969495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:06.971461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=64 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:06.976504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.976993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.977438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:06.978142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:06.978601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:06.979028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.126126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.135243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1902d15e-b542-4539-9404-70f09ad3a212 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1752 microversion: 2.1 time: 0.170355 Sep 19 11:29:07.136217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 261/527] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:07.610345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:07.610983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:07.617268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.623030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.623030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.623030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.623030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.623497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.623589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:07.623589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:07.628780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.629316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.629752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.630454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:07.630911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:07.631387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:07.812478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.817622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.821465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8de91fc3-28de-4099-9f10-b36d892eff1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.215932 Sep 19 11:29:07.822055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 267/528] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:07.826023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.827499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:07.828637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-78fb9d8b-9ee5-4e97-9945-226ff1a321dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1746 microversion: 2.20 time: 0.211446 Sep 19 11:29:07.829181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 262/529] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1746 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:08.159990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:08.160620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:08.168295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.168295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.168295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.168650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.168893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.169324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.402056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:08.410820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c19c1286-877c-49d5-908d-c50a9e8332cd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1752 microversion: 2.1 time: 0.255251 Sep 19 11:29:08.411429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 268/530] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1752 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:08.845587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:08.846824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:08.854706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:08.858617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.858617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.858617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.858962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:08.859052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.859052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.859052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.865751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.866319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.866869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:08.867686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:08.868392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:08.868896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.183983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.191496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.193866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dc2064c1-9f19-4c8d-bffa-48aa4e848846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.352093 Sep 19 11:29:09.194479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 263/531] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:09.200065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.204677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.204677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-27f30c3a-4838-439f-a280-30885acf6d9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.353233 Sep 19 11:29:09.204677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 269/532] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:09.434571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:09.435204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:09.441331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.441823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.442263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.442965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:09.443475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:09.443909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:09.616329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:09.620862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a31d42b6-d35f-4b3f-b25c-88c72a4599c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.190343 Sep 19 11:29:09.621435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 264/533] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:10.229923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:10.231378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:10.232575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:10.233194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:10.239016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.240210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.240857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.241000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.241896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.242204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.242627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.243111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.243657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.244271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.246003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.246773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.471322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:10.474207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:10.482335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:10.484049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:10.485502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bb7243ae-ff74-49b6-bc60-604be2feeabc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.257232 Sep 19 11:29:10.495268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 265/534] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:10.495491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d6dd6137-1380-4610-a66f-6ec03a6cfe45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.267116 Sep 19 11:29:10.495491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 270/535] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:10.645319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:10.646391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:10.653163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.653660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.654862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.655610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:10.656213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:10.656643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:10.830999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:10.837135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:10.845678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fdd1f782-a5fd-442d-89be-1c4d3399d5c5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.204151 Sep 19 11:29:10.865177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 266/536] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:11.515016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:11.515789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:11.518966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:11.520919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:11.522420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.522922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.523394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.524100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.524561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.524985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.528671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.529242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.529864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.530653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.531201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.531703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.748543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.751848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.761939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7a3f6394-8d7d-4de9-b300-38275ceb0fc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.250123 Sep 19 11:29:11.762617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.764283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:11.765596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-de901720-d840-4ebc-8073-a897bd6cd823 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.255510 Sep 19 11:29:11.779946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 267/537] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:11.780470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 271/538] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:11.875974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:11.877157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:11.884728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.886562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.886562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:11.887788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:11.889075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:11.889554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.105286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:12.125148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6cee6fc3-13f2-4529-83d0-a6df037e9dc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.255084 Sep 19 11:29:12.126026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 268/539] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:12.790800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:12.791466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:12.794853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:12.795492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:12.798193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.798687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.799744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.800457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.800919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.802759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.802880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.803164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.803592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:12.804309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:12.804759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:12.805177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.011622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.013990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.021540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.022934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-76f1a184-3777-4eea-8991-f234c6c0e5a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.236166 Sep 19 11:29:13.023396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 272/540] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:13.026818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.028051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7b522995-0ff0-4a88-9c2b-97e2ab4c510c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.237190 Sep 19 11:29:13.028596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 269/541] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:13.052141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:13.052566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:13.059685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.060190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.060611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.061324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.061898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.062340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.149633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:13.150233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:13.157850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.159265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.159876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.160750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:13.161357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:13.161931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:13.270252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'services' on Instance uuid d86416d5-845e-4334-93a3-1b6702121e18 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:13.364484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:13.376276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3b15f07-2a7b-416e-a639-c54a2a4b3332 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.228660 Sep 19 11:29:13.379085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 270/542] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:13.660543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-588162e3-73ef-4f77-a2e6-126052b3caee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18/os-volume_attachments/a9f1e9fc-2c2e-42fc-b4ac-19ff2270242e" status: 202 len: 0 microversion: 2.1 time: 0.623647 Sep 19 11:29:13.661087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 273/543] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:29:13 2022] DELETE /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18/os-volume_attachments/a9f1e9fc-2c2e-42fc-b4ac-19ff2270242e => generated 0 bytes in 625 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:14.058140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:14.064390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:14.065088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:14.070807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:14.082467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.085184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.085353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.085946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.086613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.087877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.088340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.088779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.093374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.094871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.096178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.097481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.338569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.340685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.347910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.349962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.351365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fb178de8-ab52-444e-b878-eb6692d72a58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.291294 Sep 19 11:29:14.352124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 274/544] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:14.354774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e2ec10af-a5ee-41f4-b733-10e4b84915ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1714 microversion: 2.1 time: 0.300534 Sep 19 11:29:14.355464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 271/545] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1714 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:14.402123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:14.402768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:14.411822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.412312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.412749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.413633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.414127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.414652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.512845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:14.513347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:14.523829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.524706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.527792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.528753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.529387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.529992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.631602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:14.646709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd932cd5-f5e5-4467-b00b-f3d5284629e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.248549 Sep 19 11:29:14.647499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 275/546] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:14.681759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] HTTP exception thrown: Cannot 'detach_volume' instance c3837b49-df54-4e20-a19e-5be03f339e84 while it is in vm_state rescued Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Request method failure captured: Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments/6e87eab9-86a5-41eb-8b1f-661c41a31725 HTTP/1.1 Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGNVNYktEzfhUQJvHMqhHDK5885Dq_w4mmZ-Ru1g2xuVoENu2t7CE6A8PssN2VKCsc7rqJMKN6hgjiCIzRV8wuFmlhnNe5PCcyISBHYGqapoAGFwwRZ-rXc1X0qoxG3kNafW7daV6Lcpq_b7u6a-msfeZS8KQ9cr3HEUFgpCHebR-M Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:29:14.683929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: d6fee905418f4d879da460b6758d4f23 Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:29:14.685611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Cannot 'detach_volume' instance c3837b49-df54-4e20-a19e-5be03f339e84 while it is in vm_state rescued Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': 'c3837b49-df54-4e20-a19e-5be03f339e84', 'id': '6e87eab9-86a5-41eb-8b1f-661c41a31725'} Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c3837b49-df54-4e20-a19e-5be03f339e84 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:14.686456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance c3837b49-df54-4e20-a19e-5be03f339e84 while it is in vm_state rescued Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance c3837b49-df54-4e20-a19e-5be03f339e84 while it is in vm_state rescued Sep 19 11:29:14.688015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:14.689147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Returning 409 to user: Cannot 'detach_volume' instance c3837b49-df54-4e20-a19e-5be03f339e84 while it is in vm_state rescued {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:14.690110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4d03dcd9-37a6-47fd-b6dd-590d833aeb42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments/6e87eab9-86a5-41eb-8b1f-661c41a31725" status: 409 len: 152 microversion: 2.1 time: 0.181510 Sep 19 11:29:14.695332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 272/547] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:29:14 2022] DELETE /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments/6e87eab9-86a5-41eb-8b1f-661c41a31725 => generated 152 bytes in 187 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 19 11:29:14.700476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:14.701180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:14.708618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.709265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.710054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.710873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:14.713018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:14.713018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:14.773693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:14.997533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8fedf044-1524-4465-865d-f253245d1677 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/action" status: 202 len: 0 microversion: 2.1 time: 0.300726 Sep 19 11:29:15.004093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 276/548] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:29:14 2022] POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:15.008188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:15.008968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:15.016061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.016692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.017247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.018174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.018749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.019409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.200876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.223365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-08a5ccbe-f9f9-4a95-9ef2-9be0ed7eef44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1722 microversion: 2.1 time: 0.218855 Sep 19 11:29:15.235633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 273/549] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:15.380601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:15.382022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:15.390949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.392020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.397632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.397632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.397632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.397632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.655154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.665947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.667891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.669460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-edb52513-fc7f-41db-aad2-6a91b9e4e547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.295595 Sep 19 11:29:15.676523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:15.678251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:15.680703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 277/550] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:15.689838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.691994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.695815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.696833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.697309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.697750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.878664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:15.879942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:15.885921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.886650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.887444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.889131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:15.890296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:15.890296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:15.920748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:29:15.936138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:15.945592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1317a5cf-cb86-4ed8-94de-129d6495af61 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.277486 Sep 19 11:29:15.946409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 274/551] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:16.254035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:16.254870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:16.261292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.261723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.262160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.262877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.263347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.263797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.410327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:16.418822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-202cee68-697c-4642-806a-4b55bb49b99b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1722 microversion: 2.1 time: 0.168944 Sep 19 11:29:16.419481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 275/552] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:16.517324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30b7a4a2-76f6-4dc4-9c30-e43861a6a65d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 204 len: 0 microversion: 2.1 time: 0.632838 Sep 19 11:29:16.518087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 278/553] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:29:15 2022] DELETE /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:29:16.527686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:16.529206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:16.536436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.536976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.537418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.538140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.539254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.539254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.698783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:16.702373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:16.703459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:16.707877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-94d6d380-52e8-46e5-a4ed-3e1e1c6d7a39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1513 microversion: 2.1 time: 0.184693 Sep 19 11:29:16.708582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 276/554] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:16 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:16.716162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.717082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.717897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.718674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.719126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.719884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.904531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:16.915629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:16.918000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:16.919797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-350ff083-93a5-4d28-8bdb-49be9d367920 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.222023 Sep 19 11:29:16.935220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 279/555] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:16.970126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:16.971612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:16.978949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.980390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.981021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:16.981907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:16.982521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:16.983104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.172804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:17.181813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ba99d1e0-876d-4994-897c-0759f6adbcdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.215838 Sep 19 11:29:17.182396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 277/556] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:17.442697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:17.443803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:17.454138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.454639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.455250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.456111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.456556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.456990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.650079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:17.660092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f12a455d-2db6-40fa-a310-382fbe044e21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1722 microversion: 2.1 time: 0.221388 Sep 19 11:29:17.676057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 280/557] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:17.733616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:17.734888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:17.742763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.743390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.743918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.744870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.745562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.746153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.898335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:17.907582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-322a652b-6d46-4959-b610-d460aef32ae7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1513 microversion: 2.1 time: 0.177870 Sep 19 11:29:17.909696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 278/558] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:17 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1513 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:17.946137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:17.946747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:17.953485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.953914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.954458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:17.955140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:17.956137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:17.956578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.116742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:18.126164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:18.128247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:18.129517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-339ed881-8759-4e31-91cc-020491800d5f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.187350 Sep 19 11:29:18.130290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 281/559] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:18.206445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:18.207051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:18.214292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.214895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.215319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.216261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.216720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.217146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.391593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:18.403271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ef64ec6d-e860-445f-bce5-04f270e2ba40 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.200957 Sep 19 11:29:18.419581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 279/560] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:18.684938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:18.685489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:18.693484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.694407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.694971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.695899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.696449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.696955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.854028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:18.860244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c0d7e5b9-acd5-44b9-bd6e-9614ecd3f9c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1722 microversion: 2.1 time: 0.179157 Sep 19 11:29:18.861012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 282/561] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:18.937702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:18.938252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:18.946331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.946831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.947310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:18.948082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:18.948925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:18.949228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.103262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:19.119565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-23e06a4b-b0af-4087-be61-fb5366b5002d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1513 microversion: 2.1 time: 0.180223 Sep 19 11:29:19.119565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 280/562] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:18 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1513 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:19.155789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:19.156433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:19.163117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.163838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.164059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.164761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.165215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.165642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.317346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:19.326581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:19.328090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:19.329261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-99d91e49-edb9-4fb3-8dd5-5b5756a9d859 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.177561 Sep 19 11:29:19.329808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 283/563] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:19.431012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:19.431744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:19.437921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.438399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.438831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.439599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.440047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.440465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.597106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:19.605625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4acb3402-6341-4a13-8b5e-e9914e8f7222 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.178594 Sep 19 11:29:19.606199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 281/564] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:19.889346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:19.889888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:19.897198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.897690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.898130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:19.898828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:19.899318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:19.899743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.034855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:20.043690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-285b76f2-9b8d-4c40-8f22-432aaf42eabf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1722 microversion: 2.1 time: 0.157961 Sep 19 11:29:20.044270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 284/565] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:20.139583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:20.140305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:20.149841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:20.150987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:20.151396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.152740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:20.153212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:20.153666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.316006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:20.325365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-292fe3bd-ee12-4fb6-bf72-814b37599e91 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1513 microversion: 2.1 time: 0.189785 Sep 19 11:29:20.335977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 282/566] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:20 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1513 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:20.356919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:20.358399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:20.366097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:20.366838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:20.367317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.368028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:20.368486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:20.368916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.523271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:20.532153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:20.533782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:20.535078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1e3f4766-01cb-4ae9-9d51-08ab59334041 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.185080 Sep 19 11:29:20.535919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 285/567] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:20.631325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:20.632111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:20.643828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:20.644735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:20.645343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.646475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:20.647080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:20.647674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:20.675187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:20.917725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:20.927466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5dcb819f-4d77-42b5-ab76-461e24684dd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.300931 Sep 19 11:29:20.928039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 283/568] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:21.068128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:21.068868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:21.075378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.075967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.076299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.076988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.077436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.077902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.298632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-670126d9-2f00-481b-b889-2c4e5a805d47 req-704a7219-1893-4e1b-9bae-dd48d3e9fda2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d86416d5-845e-4334-93a3-1b6702121e18", "name": "network-vif-deleted", "tag": "c30d6d3a-57ad-48f7-88d3-2c6f6068da33"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:21.301030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:21.309424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-670126d9-2f00-481b-b889-2c4e5a805d47 req-704a7219-1893-4e1b-9bae-dd48d3e9fda2 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.309911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-670126d9-2f00-481b-b889-2c4e5a805d47 req-704a7219-1893-4e1b-9bae-dd48d3e9fda2 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.313156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8524d4dd-6cc7-4524-9565-384668fbd4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1728 microversion: 2.1 time: 0.246083 Sep 19 11:29:21.313438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-670126d9-2f00-481b-b889-2c4e5a805d47 req-704a7219-1893-4e1b-9bae-dd48d3e9fda2 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.313554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 286/569] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:21.328986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-670126d9-2f00-481b-b889-2c4e5a805d47 req-704a7219-1893-4e1b-9bae-dd48d3e9fda2 service nova] Creating event network-vif-deleted:c30d6d3a-57ad-48f7-88d3-2c6f6068da33 for instance d86416d5-845e-4334-93a3-1b6702121e18 on hv-cinder-82282 Sep 19 11:29:21.334843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-670126d9-2f00-481b-b889-2c4e5a805d47 req-704a7219-1893-4e1b-9bae-dd48d3e9fda2 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039547 Sep 19 11:29:21.335043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:21.335484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 284/570] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:21.335633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:21.341823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.342318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.342821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.343566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.344083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.344512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.350617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:21.351329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:21.357344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.357824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.358260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.358948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.359563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.359984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.443475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:21.450339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-632ba232-19ea-461e-9448-3c586375324b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119373 Sep 19 11:29:21.450964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 287/571] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 11:29:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:29:21.459739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b6332168-bbdd-4146-aa01-26c44ad7707d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1471 microversion: 2.1 time: 0.104885 Sep 19 11:29:21.459739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 285/572] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:21 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1471 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:21.561088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:21.561694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:21.567763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.568726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.568726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.569350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.570743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.570743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.816645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:21.825182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:21.826627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:21.827824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6405f565-e3b8-4446-b6d9-8f711385a4db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1741 microversion: 2.20 time: 0.270739 Sep 19 11:29:21.828386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 286/573] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1741 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:21.951118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:21.953381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:21.959789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.960552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.961095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:21.961716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:21.962284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:21.962712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:22.475075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:22.475783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:22.482230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:22.482719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:22.483155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:22.483874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:22.484386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:22.484806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:22.520361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:22.520361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:22.520361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:22.520361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'fault' on Instance uuid d86416d5-845e-4334-93a3-1b6702121e18 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:22.524294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:22.532525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8f45f085-4b9d-45c5-bf14-361cf9f648f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.585608 Sep 19 11:29:22.533134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 288/574] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:22.561101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:22.569552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb4cda3f-fa07-4edf-b80f-d9ac8de53de7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 200 len: 1308 microversion: 2.1 time: 0.098333 Sep 19 11:29:22.570121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 287/575] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:22 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 1308 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:22.855331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:22.856038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:22.862284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:22.862869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:22.863409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:22.864171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:22.864702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:22.865199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:23.175049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:23.183671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:23.185122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:23.186291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d49c8a2f-f6f3-462d-ab12-18e640ee18f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1723 microversion: 2.20 time: 0.335033 Sep 19 11:29:23.186890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 289/576] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1723 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:23.348465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-6f4cd265-9a47-4cde-9044-fab1a4adb64a req-481dbe14-36e7-4feb-b1f6-ad6106542db0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3837b49-df54-4e20-a19e-5be03f339e84", "tag": "cbe41e13-72d5-4704-b65e-18b44b17bea1"}, {"name": "network-changed", "server_uuid": "c3837b49-df54-4e20-a19e-5be03f339e84", "tag": "cbe41e13-72d5-4704-b65e-18b44b17bea1"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:23.357874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-6f4cd265-9a47-4cde-9044-fab1a4adb64a req-481dbe14-36e7-4feb-b1f6-ad6106542db0 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:23.358353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-6f4cd265-9a47-4cde-9044-fab1a4adb64a req-481dbe14-36e7-4feb-b1f6-ad6106542db0 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:23.358779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-6f4cd265-9a47-4cde-9044-fab1a4adb64a req-481dbe14-36e7-4feb-b1f6-ad6106542db0 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:23.369812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-6f4cd265-9a47-4cde-9044-fab1a4adb64a req-481dbe14-36e7-4feb-b1f6-ad6106542db0 service nova] Creating event network-changed:cbe41e13-72d5-4704-b65e-18b44b17bea1 for instance c3837b49-df54-4e20-a19e-5be03f339e84 on hv-cinder-82282 Sep 19 11:29:23.370313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-6f4cd265-9a47-4cde-9044-fab1a4adb64a req-481dbe14-36e7-4feb-b1f6-ad6106542db0 service nova] Creating event network-changed:cbe41e13-72d5-4704-b65e-18b44b17bea1 for instance c3837b49-df54-4e20-a19e-5be03f339e84 on hv-cinder-82282 Sep 19 11:29:23.375512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-6f4cd265-9a47-4cde-9044-fab1a4adb64a req-481dbe14-36e7-4feb-b1f6-ad6106542db0 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.030681 Sep 19 11:29:23.376113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 288/577] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:23.556349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:23.556940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:23.562947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:23.563465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:23.563896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:23.564693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:23.565144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:23.565562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:23.594738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:23.600070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: d86416d5-845e-4334-93a3-1b6702121e18] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:23.605346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:23.605863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:23.606306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:23.607021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:23.607503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:23.607928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:23.623768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] HTTP exception thrown: Instance d86416d5-845e-4334-93a3-1b6702121e18 could not be found. Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Request method failure captured: Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 HTTP/1.1 Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFJEoOTjbJZCDcv9fChyLvfI4r1btyoXxi7aDQqBzkdtgLFcF1bJMaXZlknsz7voW2FeT5gvj5PqtSU9_bRqMLlQ3BNnaznGYvDzRqZS0SvzOYYkylN17blyvdJsePZIWp3WL8Ezhoc3Cb5uGuznN_eVN3GlgpcWQv_ueuvTybvotHY Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:29:23.625480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 4682f63b56d24450b2605b5b4c2129d9 Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance d86416d5-845e-4334-93a3-1b6702121e18 could not be found. Sep 19 11:29:23.626782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': 'd86416d5-845e-4334-93a3-1b6702121e18'} Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d86416d5-845e-4334-93a3-1b6702121e18 could not be found. Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:23.627614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d86416d5-845e-4334-93a3-1b6702121e18 could not be found. Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d86416d5-845e-4334-93a3-1b6702121e18 could not be found. Sep 19 11:29:23.628839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:23.632471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Returning 404 to user: Instance d86416d5-845e-4334-93a3-1b6702121e18 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:23.632471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-50f6d7f1-6846-49a3-abc3-7eb092af113e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18" status: 404 len: 111 microversion: 2.1 time: 0.037176 Sep 19 11:29:23.632471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 289/578] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:23 2022] GET /compute/v2.1/servers/d86416d5-845e-4334-93a3-1b6702121e18 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 11:29:23.735716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:23.743949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-03f7ed75-abc1-43e7-ae49-4b09ef281ac2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.191435 Sep 19 11:29:23.744525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 290/579] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:24.213961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:24.214921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:24.221684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:24.226741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:24.226741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:24.226741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:24.226741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:24.227544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:24.358502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:24.367126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:24.368611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:24.369785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb059a3b-9fc8-4223-8f6a-92348d4add6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1723 microversion: 2.20 time: 0.160309 Sep 19 11:29:24.370342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 290/580] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:24.768301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:24.768913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:24.775449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:24.775961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:24.776400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:24.777090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:24.777546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:24.777975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:24.917301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:24.920760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:24.926486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6a0da451-2caf-401a-bd6c-c7aa55b18808 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.162050 Sep 19 11:29:24.927050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 291/581] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:25.396150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:25.396706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:25.403738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:25.404218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:25.404647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:25.405341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:25.405788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:25.406211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:25.556454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:25.567015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:25.568570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:25.569735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2716f09e-f2b7-41dd-a47d-3c718f8eb5f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1723 microversion: 2.20 time: 0.177669 Sep 19 11:29:25.570308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 291/582] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:25.950116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:25.950724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:25.958027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:25.958504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:25.958934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:25.959949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:25.960398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:25.960823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:26.103293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:26.111898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7dc0e1c0-f4bd-4487-8d60-f8bd305a9336 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.165946 Sep 19 11:29:26.112480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 292/583] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:26.597724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:26.598472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:26.605317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:26.605804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:26.606272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:26.606977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:26.607452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:26.607880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:26.744491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:26.752590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:26.754061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:26.755221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bfbf0120-d628-4922-8f9a-e53cc94d41de tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1723 microversion: 2.20 time: 0.161797 Sep 19 11:29:26.755783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 292/584] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:27.045970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-3411e6b2-c12c-4b55-bfd3-96a7fc71ce73 req-2918dd5d-640e-439f-816b-36331ace366b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "name": "network-vif-unplugged", "status": "completed", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:27.057187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3411e6b2-c12c-4b55-bfd3-96a7fc71ce73 req-2918dd5d-640e-439f-816b-36331ace366b service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.057674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3411e6b2-c12c-4b55-bfd3-96a7fc71ce73 req-2918dd5d-640e-439f-816b-36331ace366b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.058097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3411e6b2-c12c-4b55-bfd3-96a7fc71ce73 req-2918dd5d-640e-439f-816b-36331ace366b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.069921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-3411e6b2-c12c-4b55-bfd3-96a7fc71ce73 req-2918dd5d-640e-439f-816b-36331ace366b service nova] Creating event network-vif-unplugged:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 11:29:27.075113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-3411e6b2-c12c-4b55-bfd3-96a7fc71ce73 req-2918dd5d-640e-439f-816b-36331ace366b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032799 Sep 19 11:29:27.075739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 293/585] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:27 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:27.136031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:27.136645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:27.142662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.143155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.143635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.144333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.144792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.145228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.291661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:27.308698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cc7485d7-2490-4f43-89b4-505bbc4441dc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1757 microversion: 2.1 time: 0.176676 Sep 19 11:29:27.309297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 293/586] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:27.781584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:27.782293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:27.788515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.789040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.789482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.790163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.790609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.791031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.929189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:27.929595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:27.931055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:27.932394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-986a2c15-f56f-486f-9ea6-a4782a5311cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1726 microversion: 2.20 time: 0.155061 Sep 19 11:29:27.932968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 294/587] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1726 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:27.959286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4186c97e-2ad1-45ce-b212-5fbe24a99966"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:27.961695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:27.968171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.968655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.969091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:27.969781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:27.970239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:27.971284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.334304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:28.335036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:28.345893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.346470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.347133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.348120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:28.348773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:28.349413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:28.539188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:28.547871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-910877d5-e703-4b3c-99a9-55a684107840 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1760 microversion: 2.1 time: 0.217873 Sep 19 11:29:28.548361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 295/588] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1760 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:29.008379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0dafe2a8-88f9-4d5d-8527-df1ba29aa760 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.054359 Sep 19 11:29:29.009005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 294/589] 10.222.0.78 () {62 vars in 1364 bytes} [Mon Sep 19 11:29:27 2022] POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 188 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:29:29.144612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:29.145305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:29.151562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:29.151979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:29.152419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:29.153117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:29.153578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:29.154004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:29.197346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121085) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 11:29:29.532985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-279001fe-0a77-45b4-8bed-d52ca0bfd525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/action" status: 202 len: 0 microversion: 2.20 time: 0.392122 Sep 19 11:29:29.533675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 296/590] 10.222.0.78 () {62 vars in 1319 bytes} [Mon Sep 19 11:29:29 2022] POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/action => generated 0 bytes in 394 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 11:29:29.541832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:29.542723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:29.551371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:29.551371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:29.552359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:29.552699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:29.553438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:29.553729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:29.704687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:29.713819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:29.715289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:29.716522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c8ef985c-a22c-44f3-9a29-bde09db171a4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1752 microversion: 2.20 time: 0.178580 Sep 19 11:29:29.717086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 295/591] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1752 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:30.742905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:30.743601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:30.754095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.754095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.754095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.754095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:30.754526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:30.754526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:30.894481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:30.905063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:30.906502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:30.907712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-df771608-6461-4587-83d4-1062a866abf9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1752 microversion: 2.20 time: 0.169040 Sep 19 11:29:30.908458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 297/592] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1752 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:31.933790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:31.934398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:31.941843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.942335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.942785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:31.943526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:31.943990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:31.944417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:32.086883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:32.096126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:32.097637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:32.098896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-56d92d70-fd95-4b34-924d-3ff93ddf8aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1752 microversion: 2.20 time: 0.169056 Sep 19 11:29:32.100087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 296/593] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1752 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:33.125311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:33.126065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:33.133544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:33.134163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:33.134485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:33.135189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:33.135644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:33.136246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:33.267996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:33.276968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:33.278434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:33.279679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d630b373-6e56-4e6c-bc0b-cfa826f081e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1754 microversion: 2.20 time: 0.158408 Sep 19 11:29:33.280210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 298/594] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:34.237534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-500161350", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "networks": [{"uuid": "363967cc-9ec5-4891-b012-fb3aab079d90"}]}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:34.292810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] validate_networks() for [('363967cc-9ec5-4891-b012-fb3aab079d90', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:29:34.305603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:34.306844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:34.313958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.314454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.317308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.317308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.317308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.317308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.738739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:34.756782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:34.758629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:34.759938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b093a0fe-f42b-4b81-8ca4-cf933f422aa2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1754 microversion: 2.20 time: 0.458453 Sep 19 11:29:34.761409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 299/595] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1754 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:34.961756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:29:34.962209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:29:34.962691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:29:34.963096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:29:34.963531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:29:34.972327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.972806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.973241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.973959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:34.974432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:34.974872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:34.992405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Getting quotas for project 575748e2f3ee4df18ce5aa403175b66f. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:29:34.996573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Getting quotas for user 4682f63b56d24450b2605b5b4c2129d9 and project 575748e2f3ee4df18ce5aa403175b66f. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:29:35.008630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:29:35.010950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:29:35.161895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8c46c878-96b3-43c3-94c0-97f97c5fb691 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.928204 Sep 19 11:29:35.162657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 297/596] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:29:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:29:35.174524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8da31d97-b359-4a39-85fe-798903252624 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:35.175117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8da31d97-b359-4a39-85fe-798903252624 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:35.177469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:35.285437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8da31d97-b359-4a39-85fe-798903252624 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:35.292845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8da31d97-b359-4a39-85fe-798903252624 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1218 microversion: 2.1 time: 0.122722 Sep 19 11:29:35.293617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 300/597] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:35 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1218 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:35.788798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:35.789410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:35.798809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.799414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.800053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.800765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:35.801289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:35.801778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:35.938657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:35.948536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:35.949969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:35.951133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f91ef139-ebed-4d34-a5c4-e631b1e5594a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.166281 Sep 19 11:29:35.951741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 298/598] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:36.317050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:36.317661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:36.324156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.324645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.325078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.325768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.326223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.326649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.388842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:36.399564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0532ed11-c859-48c5-8a4c-46fd659d2319 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1222 microversion: 2.1 time: 0.086120 Sep 19 11:29:36.401035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 301/599] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:36 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1222 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:36.979132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:36.979842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:36.986600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.987086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.987540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:36.988270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:36.988720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:36.989141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.143560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:37.147625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:37.154797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:37.157704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:37.157879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-22d50968-88b4-43d9-b92d-dd64f65ceb41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.182919 Sep 19 11:29:37.158591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 299/600] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:37.425750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:37.427203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:37.437214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.438068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.438671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.440343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:37.441153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:37.441878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:37.514685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:37.523133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9b1bfe81-73cc-4e86-879c-ff0428168e2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.101792 Sep 19 11:29:37.523741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 302/601] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:37 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:38.184266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:38.184877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:38.187603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:38.193062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:38.193559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:38.194072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:38.194861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:38.195410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:38.195837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:38.336080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:38.345823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:38.348593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:38.350057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9fecf3d4-b447-4884-8f88-2957a8161803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.170103 Sep 19 11:29:38.350979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 300/602] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:38.547437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:38.548545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:38.556189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:38.556676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:38.557107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:38.557806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:38.558254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:38.558830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:38.623756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:38.632484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-475635cb-05fa-4803-bfe0-453d2d28b7af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.088871 Sep 19 11:29:38.633074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 303/603] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:38 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:39.378373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:39.379702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:39.386722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.387233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.387679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.388382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.388980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.389415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.532655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:39.542207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:39.543691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:39.544868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf9c74fc-369f-4593-a0cb-0d83fda02f56 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.172215 Sep 19 11:29:39.545430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 301/604] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:39.656345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:39.656871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:39.664062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.664570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.665013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.665719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:39.666301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:39.666735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:39.744346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:39.752506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b2ff8ba5-efb4-42a8-85c8-bf7716f38b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.100243 Sep 19 11:29:39.753188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 304/605] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:39 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:40.570408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:40.571018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:40.577685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.578177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.578618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.579346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.579810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.580234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.726995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:40.736043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:40.738059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:40.741052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d901cff2-2d4f-4298-b8eb-cdb8a8992585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.174493 Sep 19 11:29:40.741870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 302/606] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:40.761924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:40.764217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:40.771714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.772454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.777692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.777692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.777692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.777692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.778074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:40.778846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:40.786284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.786782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.787252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.788131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.788594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.789200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.824845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-deea6cb2-aa1f-4c95-8df6-22e2079655c2 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066711 Sep 19 11:29:40.826238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 305/607] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:29:40 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 11:29:40.882645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:40.896528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2ea8bd69-c7ce-4a62-8f27-e54bd4a3457b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.123827 Sep 19 11:29:40.899043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:40.899770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:40.902940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 303/608] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:40 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:40.908721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.909810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.910284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.911067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:40.911561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:40.911996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:40.942322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:29:41.306555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f222dfa1-d872-4017-a0fc-22b6e3e145da tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 204 len: 0 microversion: 2.1 time: 0.410990 Sep 19 11:29:41.308874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 306/609] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:29:40 2022] DELETE /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 11:29:41.316564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:41.317185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:41.323538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.324036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.324599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.325392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.325914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.326288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.505718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:41.515535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fdf8b872-2741-4a81-818b-54d10994f9c4 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1671 microversion: 2.1 time: 0.203383 Sep 19 11:29:41.524949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 304/610] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:41 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1671 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:41.770396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:41.771112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:41.778494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.778990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.779450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.780359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.780823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.781243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.803016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:41.922635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:41.931183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:41.932982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.933670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.934897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.935861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:41.936526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:41.937987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:41.945679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:41.965909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:41.969286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:41.970977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9514c1f0-64ce-4c2a-aed4-e3e8d2ca5e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.205597 Sep 19 11:29:41.972055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 307/611] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:42.053326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:42.062854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2ee5aded-b52a-440e-8453-346ac1fb3c9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.143903 Sep 19 11:29:42.063988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 305/612] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:41 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:42.548587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:42.549224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:42.556466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:42.556974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:42.557414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:42.558126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:42.558592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:42.559085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:42.691388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:42.699604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2b27c703-d63d-4eec-9037-46e4fe1714d5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1671 microversion: 2.1 time: 0.155006 Sep 19 11:29:42.703144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 308/613] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:42 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1671 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:43.007727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:43.009516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:43.016161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.016659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.017090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.017797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.018800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.019250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.088242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:43.088859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:43.095763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.096256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.097252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.097964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.098499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.099083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.185842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:43.189703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:43.194790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ed06fed8-4764-4518-84fc-3930debb8f00 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.110932 Sep 19 11:29:43.195713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 309/614] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:43 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:43.201180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:43.211283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:43.212738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-51a8adcd-2836-4f10-b185-f9a15d22de96 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.208981 Sep 19 11:29:43.213431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 306/615] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:43.723721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:43.724367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:43.730408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.730899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.731366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.732156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:43.732664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:43.733041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:43.875768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:43.883983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-120b4ec4-f47b-4da7-b057-27e3f7356027 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1671 microversion: 2.1 time: 0.164780 Sep 19 11:29:43.884582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 310/616] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:43 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:44.219218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:44.219805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:44.227363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.227861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.228470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.229308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.229773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.230377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.240262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:44.240851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:44.248227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.248780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.249218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.249931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.250382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.251250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.302723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:44.311650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b0c1e55f-8a54-4111-bd0a-e92f5a3f9397 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.096706 Sep 19 11:29:44.312425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 307/617] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:44 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:44.403076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:44.413252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:44.414817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:44.416167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fe3234c5-4958-4812-b40a-4bb622965fb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.181187 Sep 19 11:29:44.417111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 311/618] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:44.910345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:44.911567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:44.917329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.917820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.918487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.919414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:44.919965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:44.920432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:44.981328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:45.007011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:45.054511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:45.062208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fd863f28-1011-4525-88e4-68db94785ada tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1671 microversion: 2.1 time: 0.158114 Sep 19 11:29:45.062777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 308/619] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:44 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1671 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:45.335016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:45.335852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:45.338238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:45.343102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.343618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.344050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:45.344840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.345302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.345724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:45.416241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:45.424376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e5418fc6-aba3-4fb1-89d6-c3df19538b1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.093565 Sep 19 11:29:45.425459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 312/620] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:45 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:45.443048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:45.443697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:45.450114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.450592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.451022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:45.451738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:45.452186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:45.452607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:45.584707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:45.593313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:45.594795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:45.595986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ed2b7122-1676-44f0-adb2-b7dfd0fd513a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.157367 Sep 19 11:29:45.597052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 309/621] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:46.086893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:46.087443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:46.093517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.093978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.094421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.095118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.095606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.096034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.224708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:46.232818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f5c18127-e6a9-47d2-9c43-ceb3698e1d33 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1671 microversion: 2.1 time: 0.149895 Sep 19 11:29:46.233061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 313/622] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:46 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:46.447525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:46.448134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:46.454537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.455017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.455491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.456975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.457331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.457757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.522275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:46.529989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-52392586-f5ce-4fff-8d9a-8c88b1826d1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.086280 Sep 19 11:29:46.531739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 310/623] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:46 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:46.622439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:46.623046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:46.629930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.630410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.630841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.631562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:46.632011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:46.632431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:46.760458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:46.769148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:46.770594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:46.771847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-879f9be3-2db7-4b5f-8e62-dfecc4fb3426 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.153429 Sep 19 11:29:46.772415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 314/624] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:47.255668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:47.256202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:47.262220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:47.262699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:47.263137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:47.263847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:47.264305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:47.264949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:47.396435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:47.404417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d98c61d2-f1dc-46f6-a5ef-0244c4a69f4e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1671 microversion: 2.1 time: 0.152881 Sep 19 11:29:47.405006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 311/625] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:47 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:47.556042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:47.556042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:47.559373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:47.559853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:47.560289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:47.560976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:47.561431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:47.561857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:47.625891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:47.634744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c0fc90d2-ff95-4dc2-9737-69ddbbb6372a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.086527 Sep 19 11:29:47.635330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 315/626] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:47 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:47.797273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:47.797884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:47.804863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:47.805351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:47.805904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:47.808623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:47.809051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:47.809478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:47.942890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:47.951806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:47.953252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:47.954443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5c251f20-96a9-4608-83a9-743d239d4ee9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.161163 Sep 19 11:29:47.955005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 312/627] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:48.428457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:48.428978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:48.434908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.435370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.435805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:48.436485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.436936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.437356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:48.604553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:48.614422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0982630d-0b7d-41b4-89dc-a2b1a0d64f9a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1671 microversion: 2.1 time: 0.190449 Sep 19 11:29:48.615287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 316/628] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:48 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1671 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:48.657492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:48.658276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:48.664930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.665500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.666170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:48.666893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.667381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.667815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:48.746391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:48.754751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7d07b3f4-5f1c-4ec6-ba1f-0545ecec42c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1270 microversion: 2.1 time: 0.101148 Sep 19 11:29:48.755361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 313/629] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:48 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1270 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:48.983101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:48.983809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:48.990856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.992714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.992714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:48.993168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:48.993776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:48.994543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.194918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:49.204444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:49.205956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:49.207131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-58734244-1e19-45cd-9078-8d40d5c67763 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.229445 Sep 19 11:29:49.225488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 317/630] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:49.631901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-2f18a2d8-2c87-4e7d-ab3a-2b8db34ad697 req-9f70a545-6fef-451d-a6cb-dedef34b4287 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01c2424a-e9d7-4e1c-918a-f7b718b4fd0d", "name": "network-vif-deleted", "tag": "1e00f0af-d58e-4616-b88f-cf53edaabac1"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:49.637489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:49.638107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:49.644722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:49.645216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:49.645657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.646360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:49.646819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:49.647159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-2f18a2d8-2c87-4e7d-ab3a-2b8db34ad697 req-9f70a545-6fef-451d-a6cb-dedef34b4287 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:49.647312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.647990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-2f18a2d8-2c87-4e7d-ab3a-2b8db34ad697 req-9f70a545-6fef-451d-a6cb-dedef34b4287 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:49.648638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-2f18a2d8-2c87-4e7d-ab3a-2b8db34ad697 req-9f70a545-6fef-451d-a6cb-dedef34b4287 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.661515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-2f18a2d8-2c87-4e7d-ab3a-2b8db34ad697 req-9f70a545-6fef-451d-a6cb-dedef34b4287 service nova] Creating event network-vif-deleted:1e00f0af-d58e-4616-b88f-cf53edaabac1 for instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d on hv-cinder-82282 Sep 19 11:29:49.669430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-2f18a2d8-2c87-4e7d-ab3a-2b8db34ad697 req-9f70a545-6fef-451d-a6cb-dedef34b4287 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041093 Sep 19 11:29:49.671984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 314/631] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:49.720138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:49.731684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cbf2132a-46a1-49e3-8775-e7b45820cbcc tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1604 microversion: 2.1 time: 0.097137 Sep 19 11:29:49.733653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 318/632] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:49 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1604 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:49.779686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:49.780647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:49.788127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:49.788929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:49.789977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.795583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:49.797239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:49.797945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:49.971986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:49.982146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9235e240-4c3c-41b8-9beb-acab624dd0c0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.207314 Sep 19 11:29:49.984642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 315/633] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:49 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:50.235493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:50.236181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:50.246768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.247298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.247744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.248459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.248922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.249353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.458249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:50.468510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:50.469792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:50.470986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8d4aec33-5def-479a-bafd-08828bb2947a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.240938 Sep 19 11:29:50.472125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 319/634] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:50.677363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-555638c1-a3bc-4307-bc85-22e23e074e2d req-8f4db8e2-4bb5-4ed4-af9d-686245bf52b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95347db7-c8c7-4731-8d6c-32d6fec8d721", "tag": "cf3336fd-b54c-402f-a55d-8aa092952d23"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:50.690682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-555638c1-a3bc-4307-bc85-22e23e074e2d req-8f4db8e2-4bb5-4ed4-af9d-686245bf52b8 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.691600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-555638c1-a3bc-4307-bc85-22e23e074e2d req-8f4db8e2-4bb5-4ed4-af9d-686245bf52b8 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.694453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-555638c1-a3bc-4307-bc85-22e23e074e2d req-8f4db8e2-4bb5-4ed4-af9d-686245bf52b8 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.706225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-555638c1-a3bc-4307-bc85-22e23e074e2d req-8f4db8e2-4bb5-4ed4-af9d-686245bf52b8 service nova] Creating event network-changed:cf3336fd-b54c-402f-a55d-8aa092952d23 for instance 95347db7-c8c7-4731-8d6c-32d6fec8d721 on hv-cinder-82282 Sep 19 11:29:50.713896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-555638c1-a3bc-4307-bc85-22e23e074e2d req-8f4db8e2-4bb5-4ed4-af9d-686245bf52b8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040795 Sep 19 11:29:50.716709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 316/635] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:50.756054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:50.756664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:50.764905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.765416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.766053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.766774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.767356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.767794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.806126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:50.806615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:50.807059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:50.807825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lazy-loading 'fault' on Instance uuid 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:29:50.855885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:50.869203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3df94080-24e0-41f6-ac5b-0388f5b5fe3b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 200 len: 1326 microversion: 2.1 time: 0.117148 Sep 19 11:29:50.890837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 320/636] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:50 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:51.008930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:51.009681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:51.016165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.016868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.017496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.018893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.020443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.021179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.211237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:51.215207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:51.220142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ea2ba486-3311-48ab-b7ed-640513e0a0d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.216216 Sep 19 11:29:51.222240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 317/637] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:51 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:51.498406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:51.499234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:51.506069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.506561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.507002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.507814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.508272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.511013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.643539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:51.652249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:51.653701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:51.654895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-952525d4-0cdc-49c8-9aee-e3a06cf0751d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.160431 Sep 19 11:29:51.655504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 321/638] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:51.902551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:51.919516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:51.919516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.919516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.919516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.919946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:51.919946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:51.919946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:51.931282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d HTTP/1.1 Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:29:51.933314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:29:51.935547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '01c2424a-e9d7-4e1c-918a-f7b718b4fd0d'} Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:29:51.936593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:29:51.938070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:29:51.939260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:29:51.939260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2cb6403e-577f-4f68-9c87-c5a22a3a0f86 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 404 len: 111 microversion: 2.1 time: 0.038640 Sep 19 11:29:51.939260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 318/639] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:51 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:29:51.945345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-59d687df-7c23-426c-a54e-1065a534833f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '.version_select at 0x7f4b9a41d4c0>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:52.043892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-59d687df-7c23-426c-a54e-1065a534833f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-620316827" status: 202 len: 0 microversion: 2.1 time: 0.102966 Sep 19 11:29:52.044483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 322/640] 10.222.0.78 () {58 vars in 1218 bytes} [Mon Sep 19 11:29:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-620316827 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:29:52.245438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:52.246060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:52.252710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:52.255047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:52.255047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:52.255047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:52.255047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:52.255654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:52.404609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:52.413464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4b8bedb7-ca90-479b-9945-304a24b676c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.171914 Sep 19 11:29:52.413970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 319/641] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:52 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:52.680435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:52.681042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:52.687579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:52.688064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:52.688503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:52.689203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:52.689662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:52.690092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:52.826051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:52.835794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:52.837262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:52.838443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6f92e80b-008a-45c3-aa78-eb68bc0cb3f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.162128 Sep 19 11:29:52.839004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 323/642] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:52.892172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-38a5cb27-b6d1-4ae2-905e-24220a3bfb66 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'create', calling method: .version_select at 0x7f4b9a338af0>, body: {"keypair": {"name": "tempest-keypair-1254060146", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL7vEtyBUWD73GUhuaSk6QpIFXJsRwnNRfLy+sFN3LCePF/Fu8pE7c/L6pnoPo1dr3fAV28v6BtxXF2gnO6D4GgHG3Y1ZdfGWomIxxFKpiu+rSIPtYf6U6Lz8OtErtFvuw=="}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:52.909250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-38a5cb27-b6d1-4ae2-905e-24220a3bfb66 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for project 4767407e0fb04faaaa3a520128aa88df. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:29:52.913154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-38a5cb27-b6d1-4ae2-905e-24220a3bfb66 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for user 405b3189506a44bc93555c40917b4cbe and project 4767407e0fb04faaaa3a520128aa88df. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:29:52.926258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR oslo.messaging._drivers.impl_rabbit [None req-38a5cb27-b6d1-4ae2-905e-24220a3bfb66 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [5ff59a7c-97ba-457f-90c3-d1fd26da6839] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 11:29:53.435952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:53.436514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:53.443277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:53.443769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:53.444212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:53.444903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:53.445364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:53.445794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:53.572334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:53.575693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:29:53.580128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ed644f7f-f564-455b-b5cc-ca4da119df49 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.148153 Sep 19 11:29:53.580693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 324/643] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:53 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:53.866347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:53.867008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:53.873679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:53.874158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:53.874598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:53.875313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:53.875778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:53.876186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:53.933691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [None req-38a5cb27-b6d1-4ae2-905e-24220a3bfb66 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [5ff59a7c-97ba-457f-90c3-d1fd26da6839] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 34580. Sep 19 11:29:54.004076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-38a5cb27-b6d1-4ae2-905e-24220a3bfb66 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.115682 Sep 19 11:29:54.004806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 320/644] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 11:29:52 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:54.014783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:54.024270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:54.025844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:54.027092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7648c795-9387-4820-aabb-a8615765929c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.165369 Sep 19 11:29:54.027684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 325/645] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:54.603963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:54.604663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:54.611482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.611970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.612407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:54.613098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:54.614094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:54.614522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:54.829238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:54.837190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dbbaa43b-312d-4947-afb6-6ffc42eb9893 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.237658 Sep 19 11:29:54.837767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 321/646] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:54 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:55.061041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:55.062082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:55.069527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:55.070288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:55.070743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:55.071490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:55.072294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:55.072957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:55.486438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:55.498253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:55.499846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:55.501112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3ae97d36-835f-4575-ac83-4db1dbd444af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.444421 Sep 19 11:29:55.512724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 326/647] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:29:55.861054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:55.862207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:55.872797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:55.873296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:55.873758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:55.874453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:55.874982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:55.875442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:56.044398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:56.052060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7f397a41-d1d2-4afd-9eb3-66cf89aba47c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.195557 Sep 19 11:29:56.053506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 322/648] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:55 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:56.527098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:56.528272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:56.535744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:56.536234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:56.536764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:56.537469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:56.537936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:56.538361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:56.565049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-430496381", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bade7eef-3602-4313-86ff-efde9395cb00"}], "security_groups": [{"name": "tempest-securitygroup--1316920615"}], "key_name": "tempest-keypair-1254060146", "user_data": "}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:56.728495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] validate_networks() for [('bade7eef-3602-4313-86ff-efde9395cb00', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:29:56.776740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:56.786165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:56.787552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:56.788712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f958a4b7-2a18-4ae3-92fa-41649fa77706 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.266284 Sep 19 11:29:56.789280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 327/649] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:57.075649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:57.076182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:57.082646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.083197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.083910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.084600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.085064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.085488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.119819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:29:57.120488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:29:57.121040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:29:57.121545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:29:57.122025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:29:57.131120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.131732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.132237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.133039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.133581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.134083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.151626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for project 4767407e0fb04faaaa3a520128aa88df. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:29:57.156562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Getting quotas for user 405b3189506a44bc93555c40917b4cbe and project 4767407e0fb04faaaa3a520128aa88df. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:29:57.168797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:29:57.171264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:29:57.229687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:57.237250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd83ad07-d5e9-4478-bee5-c19487ddf0f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.165560 Sep 19 11:29:57.237807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 328/650] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:57 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:57.290183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2cefb1a5-4aee-4be5-9b7c-9d0e6e00e86f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.729432 Sep 19 11:29:57.290844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 323/651] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:29:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 731 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:29:57.302092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-599bc60d-4989-4b3e-903c-0d9f7d8bc30d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:57.303717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-599bc60d-4989-4b3e-903c-0d9f7d8bc30d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:57.359225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-599bc60d-4989-4b3e-903c-0d9f7d8bc30d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:57.366498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-599bc60d-4989-4b3e-903c-0d9f7d8bc30d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1237 microversion: 2.1 time: 0.068259 Sep 19 11:29:57.367081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 329/652] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:57 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1237 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:57.815867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:57.816758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:57.824022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.824663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.825211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.826075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.826589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.827123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:57.984789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:57.986304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-3badc665-6baf-428f-b56a-0a1598f78085 req-f99acb66-1cb5-4613-aafb-af8d325b5734 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95347db7-c8c7-4731-8d6c-32d6fec8d721", "name": "network-vif-plugged", "status": "completed", "tag": "cf3336fd-b54c-402f-a55d-8aa092952d23"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:29:57.998319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3badc665-6baf-428f-b56a-0a1598f78085 req-f99acb66-1cb5-4613-aafb-af8d325b5734 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:57.998895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3badc665-6baf-428f-b56a-0a1598f78085 req-f99acb66-1cb5-4613-aafb-af8d325b5734 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:57.999358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3badc665-6baf-428f-b56a-0a1598f78085 req-f99acb66-1cb5-4613-aafb-af8d325b5734 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.002842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:58.004999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:58.006400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f25f8301-03a5-4c56-8b01-b755a15b6fa3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.194823 Sep 19 11:29:58.007287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 324/653] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:58.012085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-3badc665-6baf-428f-b56a-0a1598f78085 req-f99acb66-1cb5-4613-aafb-af8d325b5734 service nova] Creating event network-vif-plugged:cf3336fd-b54c-402f-a55d-8aa092952d23 for instance 95347db7-c8c7-4731-8d6c-32d6fec8d721 on hv-cinder-82282 Sep 19 11:29:58.017217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-3badc665-6baf-428f-b56a-0a1598f78085 req-f99acb66-1cb5-4613-aafb-af8d325b5734 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035998 Sep 19 11:29:58.017812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 330/654] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:29:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:29:58.260738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:58.262139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:58.268747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:58.270478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:58.271141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.271965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:58.272539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:58.273059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.390422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:58.391151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:58.398648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:58.399156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:58.399625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.400734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:58.405776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:58.405776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:58.491217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:58.502405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:58.507812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1b83bd6f-cf28-41d9-8e8f-1d15866ca35f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1241 microversion: 2.1 time: 0.121381 Sep 19 11:29:58.514817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 331/655] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:58 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1241 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:29:58.517877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0f9aad6b-12d4-466a-a04f-7b792320a2b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.260897 Sep 19 11:29:58.518664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 325/656] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:58 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:59.034001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:59.034614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:59.041753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.043120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.043120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.043357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.043898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.044325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.182581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:59.191977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:59.193430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:59.194598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0f6aa3de-fbea-4608-a969-6ad3f291a217 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.164640 Sep 19 11:29:59.195188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 332/657] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:29:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:29:59.530697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:59.531333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:59.538472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.538957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.539417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.540110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.540568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.540993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.541207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:29:59.541800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:29:59.547728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.548208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.548637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.549343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:29:59.549793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:29:59.550211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:29:59.628730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:59.637507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8cad7560-eb67-4dac-9cf1-4ff966aef970 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1289 microversion: 2.1 time: 0.110809 Sep 19 11:29:59.644038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 326/658] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:59 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1289 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:29:59.698809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:29:59.706682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42baa253-f921-4977-b4ce-0b07bd30b346 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1318 microversion: 2.1 time: 0.169425 Sep 19 11:29:59.707253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 333/659] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:29:59 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1318 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:00.032602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-9904c1c1-ad43-491b-8bd3-145a4e15c0b0 req-3352b1b0-c671-4fa6-b4ab-81372ea08986 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "name": "network-vif-plugged", "status": "completed", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:00.042347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-9904c1c1-ad43-491b-8bd3-145a4e15c0b0 req-3352b1b0-c671-4fa6-b4ab-81372ea08986 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.042824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-9904c1c1-ad43-491b-8bd3-145a4e15c0b0 req-3352b1b0-c671-4fa6-b4ab-81372ea08986 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.043280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-9904c1c1-ad43-491b-8bd3-145a4e15c0b0 req-3352b1b0-c671-4fa6-b4ab-81372ea08986 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.056808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-9904c1c1-ad43-491b-8bd3-145a4e15c0b0 req-3352b1b0-c671-4fa6-b4ab-81372ea08986 service nova] Creating event network-vif-plugged:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 11:30:00.061980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-9904c1c1-ad43-491b-8bd3-145a4e15c0b0 req-3352b1b0-c671-4fa6-b4ab-81372ea08986 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033159 Sep 19 11:30:00.062584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 327/660] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:00.220932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:00.221516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:00.228800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.229295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.229739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.230484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.230952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.231642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.379245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:00.388370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:00.389826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:00.390990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-74ca94ff-c001-4c05-9f92-8a25e5eda7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.174293 Sep 19 11:30:00.391578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 334/661] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:30:00.661262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:00.661954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:00.668174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.668657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.669094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.669782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.670238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.670669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.729340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:00.729974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:00.733148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:00.736394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.736910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.737349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.738567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.739034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.739563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.741495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e28d6129-a044-43f0-a0e1-1d97360b3a2f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1289 microversion: 2.1 time: 0.084953 Sep 19 11:30:00.742124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 328/662] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:00 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1289 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:00.869555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:00.877259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fdee4520-7e1b-4593-a8c8-414e0eb78dca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1506 microversion: 2.1 time: 0.151801 Sep 19 11:30:00.877830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 335/663] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:00 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1506 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:00.910047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ed5634c5-3a81-4fb1-9737-86409b2a798b", "device": "/dev/sdb"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:00.913038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:00.918925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.919445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.919925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:00.920619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:00.921084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:00.921504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.417693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:01.418452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:01.425062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.425551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.425982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.426677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.427190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.427778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.563864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:01.573333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:01.574785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:01.575981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8cc795fc-24fa-4af6-a6a9-cd83ccc46860 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.162555 Sep 19 11:30:01.576544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 336/664] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:30:01.765829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:01.766375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:01.772478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.777249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.777249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.777249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:01.777249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:01.777633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:01.820576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-561f6ccb-2943-419b-a8b4-46b80c2f9bfc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "POST /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.914612 Sep 19 11:30:01.821718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 329/665] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 11:30:00 2022] POST /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments => generated 194 bytes in 917 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:01.843594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:01.846678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-62872074-7285-4b71-a3ef-7e972db3bdb5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1307 microversion: 2.1 time: 0.085577 Sep 19 11:30:01.847316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 337/666] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:01 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1307 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:02.396098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:02.396954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:02.403851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.404358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.404801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.405521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.405982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.406412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.507248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lazy-loading 'services' on Instance uuid c3837b49-df54-4e20-a19e-5be03f339e84 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:02.602076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:02.602680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:02.609452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.611481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.611481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.611481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.611796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.612154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.734787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7755cc83-d507-4922-82e1-22f65cf81664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments/6e87eab9-86a5-41eb-8b1f-661c41a31725" status: 202 len: 0 microversion: 2.1 time: 0.344057 Sep 19 11:30:02.735440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 330/667] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:30:02 2022] DELETE /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments/6e87eab9-86a5-41eb-8b1f-661c41a31725 => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:30:02.744543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:02.746897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:02.753172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.754192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.754643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.755395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.755853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.756282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.786884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-42be4f3d-c2f9-4c12-bee1-be61e3091e2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046548 Sep 19 11:30:02.787758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 331/668] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:02.848372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:02.857243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:02.858759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:02.860193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-18a0d72e-1030-401d-b9b9-92e4c4e691ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.262152 Sep 19 11:30:02.860761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 338/669] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:30:02.873083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:02.873991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:02.880875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.881367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.881810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:02.882519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:02.882978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:02.883455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:03.052688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:03.060658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-36eb97ce-3881-463b-9514-a7f6da72215e tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.191954 Sep 19 11:30:03.061243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 332/670] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:02 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:03.472947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-c12a9c77-bcf5-45fc-bd37-fa252c14d50e req-dff85515-15fa-46e3-8473-98d114044a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908c5502-74d2-42f5-bd69-d99ade535859", "tag": "627f1e13-4c39-42fa-ad5b-1f09b1a2ff71"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:03.491207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c12a9c77-bcf5-45fc-bd37-fa252c14d50e req-dff85515-15fa-46e3-8473-98d114044a11 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:03.491724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c12a9c77-bcf5-45fc-bd37-fa252c14d50e req-dff85515-15fa-46e3-8473-98d114044a11 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:03.492312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c12a9c77-bcf5-45fc-bd37-fa252c14d50e req-dff85515-15fa-46e3-8473-98d114044a11 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:03.503613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-c12a9c77-bcf5-45fc-bd37-fa252c14d50e req-dff85515-15fa-46e3-8473-98d114044a11 service nova] Creating event network-changed:627f1e13-4c39-42fa-ad5b-1f09b1a2ff71 for instance 908c5502-74d2-42f5-bd69-d99ade535859 on hv-cinder-82282 Sep 19 11:30:03.511131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-c12a9c77-bcf5-45fc-bd37-fa252c14d50e req-dff85515-15fa-46e3-8473-98d114044a11 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044832 Sep 19 11:30:03.511371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 339/671] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:03.801514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:03.804116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:03.810590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:03.811076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:03.811580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:03.812281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:03.812743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:03.813186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:03.845334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b18b1ea4-ecb6-4b03-9b52-5d3d532a925a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048914 Sep 19 11:30:03.845916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 333/672] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:03.889339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:03.890031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:03.896878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:03.897361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:03.897843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:03.898482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:03.898935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:03.899378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:04.087118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:04.092925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:04.093851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:04.094336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:04.094771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:04.095497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:04.095952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:04.096377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:04.245862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:04.245862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:04.246185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:04.246185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce99fcf6-41e5-4b7b-a9a5-8d9d0cf7facd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.287521 Sep 19 11:30:04.246185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 340/673] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:30:04.327725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:04.338598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-10598a06-0bdc-42d2-a956-e2fe127f169f tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.256514 Sep 19 11:30:04.339381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 334/674] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:04 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:04.858530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:04.860829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:04.867560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:04.868051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:04.868503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:04.869195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:04.869649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:04.870076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:04.898836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8e3ab7f3-a2ad-4296-8a00-32a863878ed6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044383 Sep 19 11:30:04.899520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 341/675] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:05.197585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:05.198200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:05.204936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:05.205424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:05.205892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:05.206588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:05.207672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:05.208385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:05.229436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:05.344887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:05.354653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:05.356472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:05.357509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1871e46f-3cff-449c-90cb-1cfc3429746f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1810 microversion: 2.20 time: 0.163925 Sep 19 11:30:05.358074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 335/676] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:30:05.362750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:05.363442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:05.365552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:05.370327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:05.370769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:05.371476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:05.372175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:05.372633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:05.373059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:05.507556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:05.517125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-64c6a021-335f-4d36-9665-08dffab2a765 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.158844 Sep 19 11:30:05.517964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 342/677] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:05 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:05.911649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:05.913889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:05.919884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:05.920370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:05.920806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:05.921487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:05.921973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:05.922394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:05.953597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-299bef11-1dac-4faa-bb96-31a00219a38c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045987 Sep 19 11:30:05.954187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 336/678] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:06.383824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:06.384424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:06.391396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:06.391887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:06.392328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:06.393048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:06.393511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:06.393941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:06.527911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:06.531329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:06.537268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:06.540240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:06.540240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ae30a206-5a99-4a2e-b72a-4cbd31ef2095 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1797 microversion: 2.20 time: 0.159967 Sep 19 11:30:06.541879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:06.542500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:06.544938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:06.545937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 343/679] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:30:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1797 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:30:06.549902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:06.551099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:06.551572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:06.552276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:06.552736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:06.553167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:06.696617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:06.704653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5aae254c-6fb0-4d77-8174-43ef7dd82784 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.166748 Sep 19 11:30:06.705241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 337/680] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:06 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:06.967076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:06.969271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:06.975501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:06.976021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:06.976461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:06.977157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:06.977615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:06.978044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:07.009356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e89f429-018c-4639-b8ad-4d2f39223f03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046691 Sep 19 11:30:07.009932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 344/681] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:07.729063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:07.729785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:07.731721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:07.732418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=10 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:07.737734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:07.738405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:07.739447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:07.742771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:07.742771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:07.742771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:07.876072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:07.883667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-028fa67a-b46d-4d94-8365-14d77b154f90 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.158643 Sep 19 11:30:07.884228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 338/682] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:07 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:08.023019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:08.026091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:08.028677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:08.034097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:08.034587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:08.035667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:08.036317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:08.036778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:08.037799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:08.073573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c827498c-8510-4653-b5a2-0c420ed9a4a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054835 Sep 19 11:30:08.074162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 345/683] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:08.215799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1365930836"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:08.216334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:08.223209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:08.223699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:08.224200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:08.224909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:08.225366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:08.225797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:08.355074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.network.security_group_api [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Removing security group f77d1d69-a1db-4e23-a349-ca49f9c16007 from port 6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 Sep 19 11:30:08.963310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:08.963969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:08.967644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-58748067-01f3-4cec-b70b-c134160982ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action" status: 202 len: 0 microversion: 2.1 time: 0.754840 Sep 19 11:30:08.971249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:08.971588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:08.972252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:08.973641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 339/684] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:30:08 2022] POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action => generated 0 bytes in 762 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:30:08.973822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:08.974452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:08.975255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:08.982422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-85a3b755-a827-4425-bf5c-a1fa84bc9794 req-102cd924-79c1-4ce1-9148-8bff7f59b8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416dd466-0154-4d9a-af4a-9f87010ce3a3", "tag": "6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:09.009328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-85a3b755-a827-4425-bf5c-a1fa84bc9794 req-102cd924-79c1-4ce1-9148-8bff7f59b8a8 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:09.010260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-85a3b755-a827-4425-bf5c-a1fa84bc9794 req-102cd924-79c1-4ce1-9148-8bff7f59b8a8 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:09.010885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-85a3b755-a827-4425-bf5c-a1fa84bc9794 req-102cd924-79c1-4ce1-9148-8bff7f59b8a8 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:09.029860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-85a3b755-a827-4425-bf5c-a1fa84bc9794 req-102cd924-79c1-4ce1-9148-8bff7f59b8a8 service nova] Creating event network-changed:6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 for instance 416dd466-0154-4d9a-af4a-9f87010ce3a3 on hv-cinder-82282 Sep 19 11:30:09.036139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-85a3b755-a827-4425-bf5c-a1fa84bc9794 req-102cd924-79c1-4ce1-9148-8bff7f59b8a8 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061410 Sep 19 11:30:09.037949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 340/685] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:09.089635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:09.091976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:09.099002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:09.104677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:09.104677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:09.104677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:09.104677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:09.105124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:09.145394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-064e0113-5d1d-4a00-a8a8-e1c25ef43c7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060743 Sep 19 11:30:09.146315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 341/686] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:09.297307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:09.306959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f4bbff10-ec7d-4550-8e1e-c1e84bdfb8e0 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.404815 Sep 19 11:30:09.323343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 346/687] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:08 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:09.622537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-d76bd750-8339-40bc-81ba-d93f961d8f9b req-cfbf6544-6dff-4c40-862d-b2f594434453 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908c5502-74d2-42f5-bd69-d99ade535859", "name": "network-vif-plugged", "status": "completed", "tag": "627f1e13-4c39-42fa-ad5b-1f09b1a2ff71"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:09.636719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d76bd750-8339-40bc-81ba-d93f961d8f9b req-cfbf6544-6dff-4c40-862d-b2f594434453 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:09.636719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d76bd750-8339-40bc-81ba-d93f961d8f9b req-cfbf6544-6dff-4c40-862d-b2f594434453 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:09.636719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d76bd750-8339-40bc-81ba-d93f961d8f9b req-cfbf6544-6dff-4c40-862d-b2f594434453 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:09.646161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-d76bd750-8339-40bc-81ba-d93f961d8f9b req-cfbf6544-6dff-4c40-862d-b2f594434453 service nova] Creating event network-vif-plugged:627f1e13-4c39-42fa-ad5b-1f09b1a2ff71 for instance 908c5502-74d2-42f5-bd69-d99ade535859 on hv-cinder-82282 Sep 19 11:30:09.651034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-d76bd750-8339-40bc-81ba-d93f961d8f9b req-cfbf6544-6dff-4c40-862d-b2f594434453 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032649 Sep 19 11:30:09.651729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 342/688] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:10.158625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:10.161021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:10.168741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.168741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.169012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.169728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.170185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.170609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.202615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ae68620c-80ed-4082-be47-64e5b15bc9bc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048113 Sep 19 11:30:10.203248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 347/689] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:10.331206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:10.332558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:10.339182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.339582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.340015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.340713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.341170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.341595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.584056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:10.592625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cdbf4af1-47c2-4b95-b955-53449a77f19a tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.265909 Sep 19 11:30:10.593277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 343/690] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:10 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:10.602594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:10.603142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:10.609080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.610692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.610692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.610692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.611124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.611573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.698005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lazy-loading 'services' on Instance uuid 416dd466-0154-4d9a-af4a-9f87010ce3a3 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:10.935876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f78e2315-721c-4d6e-ab9f-1802c2d0b0e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128" status: 202 len: 0 microversion: 2.1 time: 0.341589 Sep 19 11:30:10.936295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 348/691] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:30:10 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:30:10.946935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:10.949788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:10.956250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.956984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.957557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.958653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:10.959236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:10.959763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:10.991126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3115e469-7ab8-42d2-bb16-007b171e9b0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050195 Sep 19 11:30:10.991907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 344/692] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:11.057028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-a1b05337-835d-4a9e-9e43-18f99f9ed91f req-4e095545-7f54-464b-9193-aea36a0e684c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "416dd466-0154-4d9a-af4a-9f87010ce3a3", "tag": "6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:11.066886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-a1b05337-835d-4a9e-9e43-18f99f9ed91f req-4e095545-7f54-464b-9193-aea36a0e684c service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:11.067459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-a1b05337-835d-4a9e-9e43-18f99f9ed91f req-4e095545-7f54-464b-9193-aea36a0e684c service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:11.067943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-a1b05337-835d-4a9e-9e43-18f99f9ed91f req-4e095545-7f54-464b-9193-aea36a0e684c service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:11.079293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-a1b05337-835d-4a9e-9e43-18f99f9ed91f req-4e095545-7f54-464b-9193-aea36a0e684c service nova] Creating event network-changed:6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 for instance 416dd466-0154-4d9a-af4a-9f87010ce3a3 on hv-cinder-82282 Sep 19 11:30:11.085013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-a1b05337-835d-4a9e-9e43-18f99f9ed91f req-4e095545-7f54-464b-9193-aea36a0e684c service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032405 Sep 19 11:30:11.085865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 349/693] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:11.217743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:11.219876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:11.226844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:11.227383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:11.227821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:11.228568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:11.229025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:11.229447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:11.301594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-024cd367-61fd-4f96-87d3-45fc66349a30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087151 Sep 19 11:30:11.303610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 345/694] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:11.618320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:11.619009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:11.625861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:11.626359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:11.626800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:11.627774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:11.628965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:11.629400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:11.765495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:11.773880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f0a144d9-586a-4f59-8136-d7a4d4165019 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1363 microversion: 2.1 time: 0.161302 Sep 19 11:30:11.774447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 350/695] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:11 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:30:12.005199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:12.007425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:12.014112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.014566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.015008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:12.023613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.023613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.023613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:12.046755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a5a80371-14d5-43f9-9b1a-84ffe6c40ca7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046083 Sep 19 11:30:12.047359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 346/696] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:12.316030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:12.318188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:12.324237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.324724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.325158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:12.325854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.326310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.326735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:12.364686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-72604528-1820-477e-bdfe-aa0feea69897 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052498 Sep 19 11:30:12.365080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 351/697] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:12.796999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:12.797617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:12.803736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.804227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.804672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:12.805364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.805824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.806255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:12.938095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '405b3189506a44bc93555c40917b4cbe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4767407e0fb04faaaa3a520128aa88df', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:12.946489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-19c41af6-b4f1-4e6a-a42a-e6343ea74499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 200 len: 1548 microversion: 2.1 time: 0.153821 Sep 19 11:30:12.947058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 347/698] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:12 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:12.969481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:12.970009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:12.976610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.977094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.977532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:12.978262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:12.978721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:12.979209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:13.056204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e5297c1b-e618-4b32-b3db-4ccc4a52a702 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090564 Sep 19 11:30:13.056802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 352/699] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 11:30:12 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:13.060018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:13.062191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:13.069154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:13.070577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:13.071018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:13.071784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:13.072235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:13.072660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:13.102751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b581d97f-a477-4788-998c-0a32501bb53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046540 Sep 19 11:30:13.103351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 348/700] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:13.379148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:13.379517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:13.385557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:13.386044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:13.386483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:13.387229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:13.387658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:13.388083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:13.419022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce3d5e70-5724-454c-a7da-cc9de24f98b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Sep 19 11:30:13.419641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 353/701] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:14.116071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:14.119082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:14.125628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:14.126110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:14.126539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:14.127267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:14.127724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:14.128148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:14.158448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ca79c80a-bf71-4643-b86b-b9d4ec37d94f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046866 Sep 19 11:30:14.159034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 349/702] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:14.289086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-c7571289-91ad-471c-a293-71d7e130646f req-fd18c4df-7f0e-41da-bee2-6801bba37376 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "908c5502-74d2-42f5-bd69-d99ade535859", "tag": "627f1e13-4c39-42fa-ad5b-1f09b1a2ff71"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:14.299049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c7571289-91ad-471c-a293-71d7e130646f req-fd18c4df-7f0e-41da-bee2-6801bba37376 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:14.299672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c7571289-91ad-471c-a293-71d7e130646f req-fd18c4df-7f0e-41da-bee2-6801bba37376 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:14.300187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c7571289-91ad-471c-a293-71d7e130646f req-fd18c4df-7f0e-41da-bee2-6801bba37376 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:14.312484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-c7571289-91ad-471c-a293-71d7e130646f req-fd18c4df-7f0e-41da-bee2-6801bba37376 service nova] Creating event network-changed:627f1e13-4c39-42fa-ad5b-1f09b1a2ff71 for instance 908c5502-74d2-42f5-bd69-d99ade535859 on hv-cinder-82282 Sep 19 11:30:14.317508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-c7571289-91ad-471c-a293-71d7e130646f req-fd18c4df-7f0e-41da-bee2-6801bba37376 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032835 Sep 19 11:30:14.318122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 354/703] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:30:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:14.432025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:14.434585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:14.445072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:14.445941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:14.446613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:14.447593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:14.448122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:14.448622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:14.480867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3d122ff9-3acb-41fb-854e-53fe23498193 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052725 Sep 19 11:30:14.481580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 350/704] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:15.172575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:15.175037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:15.181998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:15.186530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:15.186530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:15.186530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:15.186530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:15.186926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:15.217629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-37214c97-a158-463f-b17d-fddbcade0b33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049468 Sep 19 11:30:15.218366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 355/705] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:15.494344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:15.497066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:15.503573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:15.504345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:15.505029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:15.505926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:15.506564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:15.510106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:15.539455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-815608b8-100f-48fb-ae57-5ba393e41ab4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049192 Sep 19 11:30:15.540043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 351/706] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:16.230919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:16.233310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:16.239801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:16.240287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:16.240725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:16.241494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:16.242098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:16.242529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:16.272791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c030e4d9-360f-47ff-b0c2-306a13ac1492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Sep 19 11:30:16.273357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 356/707] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:16.552409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:16.554629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:16.561295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:16.561785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:16.562222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:16.562917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:16.563456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:16.563838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:16.594047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aecccea7-bb5b-4952-8ea0-a0d351f68ed2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Sep 19 11:30:16.594619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 352/708] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:17.286231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:17.289133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:17.296120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:17.296613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:17.297058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:17.297939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:17.298560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:17.299247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:17.329003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a9f2af96-0678-444b-9c41-a31a1beac20c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047387 Sep 19 11:30:17.329756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 357/709] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:17.606203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:17.608399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:17.615006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:17.615525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:17.615950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:17.616627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:17.617100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:17.617517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:17.642908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:17.648258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6018a22d-2625-41f2-b515-e5de85236b04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Sep 19 11:30:17.649769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 353/710] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:18.342519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:18.344694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:18.351117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:18.351626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:18.352057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:18.352737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:18.353268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:18.353609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:18.382791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-482ccfb2-a352-45ed-ada0-db6798d18d60 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Sep 19 11:30:18.383388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 358/711] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:18.663363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:18.665444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:18.672053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:18.672549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:18.672988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:18.673678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:18.674136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:18.674564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:18.703652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b4c69f11-c8e6-4461-b2b3-222c50d897f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046268 Sep 19 11:30:18.704223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 354/712] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:19.395375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:19.397589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:19.404038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:19.404516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:19.404944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:19.405629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:19.406075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:19.406491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:19.436189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa032b47-a03f-4ece-9b72-b249494fb751 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Sep 19 11:30:19.436986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 359/713] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:19.717011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:19.719054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:19.726118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:19.726605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:19.727048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:19.727804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:19.728263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:19.728699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:19.759800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6c5140bb-dd9e-4bac-8e70-c8de8ae6131b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Sep 19 11:30:19.760357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 355/714] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:20.449806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:20.451871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:20.459089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:20.459605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:20.460042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:20.460719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:20.461167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:20.461585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:20.492126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f9c53969-71a2-4bbb-a168-5568351cfa4e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046385 Sep 19 11:30:20.492735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 360/715] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:20.772580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:20.774984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:20.781449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:20.781937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:20.782376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:20.783070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:20.783556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:20.783986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:20.814442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ea7e30a2-f643-4ea1-9760-5dfd3b677613 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045824 Sep 19 11:30:20.815010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 356/716] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:21.505581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:21.507728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:21.514104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:21.514608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:21.515038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:21.515754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:21.516203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:21.516624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:21.534500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:21.547785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9da4f969-51c0-433f-9a4e-f12bf6aab68a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046650 Sep 19 11:30:21.548356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 361/717] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:21.827419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:21.829579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:21.836874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:21.838199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:21.838654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:21.839398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:21.839859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:21.840284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:21.871786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f13dde41-9f87-444a-b5eb-8aedc9cc82a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048304 Sep 19 11:30:21.872377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 357/718] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:22.561115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:22.563316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:22.570017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:22.570509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:22.570947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:22.571675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:22.572129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:22.572553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:22.602844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a8986cb2-cc67-475f-bfff-7d856d0c2df0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046041 Sep 19 11:30:22.603436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 362/719] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:22.884883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:22.887137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:22.893867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:22.894353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:22.894793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:22.895616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:22.896582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:22.897011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:22.926387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a06d9f17-1aa9-401d-82af-d2ed521390dd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045559 Sep 19 11:30:22.926982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 358/720] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:23.616672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:23.618897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:23.625772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:23.626260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:23.626703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:23.627441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:23.627902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:23.628328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:23.657740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-162cb06e-1820-4402-a61f-61fd3527b66b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046252 Sep 19 11:30:23.658311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 363/721] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:23.939278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:23.941368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:23.948444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:23.948936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:23.949375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:23.950066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:23.950533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:23.950962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:23.980457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-761dc31b-ecc2-4d31-8e11-bd124778de7f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045294 Sep 19 11:30:23.981021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 359/722] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:24.670075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:24.672269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:24.678639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:24.679116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:24.679579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:24.680255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:24.680701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:24.681120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:24.710276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e60f35c-76ca-4302-a098-e7f538943788 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044180 Sep 19 11:30:24.710830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 364/723] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:24.993798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:24.996256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:25.002900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:25.003427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:25.003866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:25.004567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:25.005019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:25.005447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:25.035129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cc363224-cbe8-4a79-9ceb-05592920957d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046141 Sep 19 11:30:25.036228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 360/724] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:25.723411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:25.725587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:25.732917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:25.733407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:25.733850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:25.734554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:25.735047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:25.735655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:25.766941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e2fccc47-173c-4af6-9b57-b2788ae5302f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048289 Sep 19 11:30:25.767542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 365/725] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:26.048333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:26.050568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:26.057534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:26.058028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:26.058470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:26.059186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:26.059646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:26.060070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:26.090006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e8b161f-99c5-4bac-959d-660101609598 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Sep 19 11:30:26.090567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 361/726] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:26.780320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:26.782443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:26.789975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:26.791142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:26.791511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:26.792317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:26.792873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:26.793478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:26.823126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d123fa30-500c-4b67-8294-85b6615d7a70 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046703 Sep 19 11:30:26.823726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 366/727] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:27.102783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:27.104929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:27.111676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:27.112165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:27.112608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:27.113314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:27.113769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:27.114200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:27.144271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0b1def57-6619-4bd3-81af-2091e4a2d157 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046166 Sep 19 11:30:27.144831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 362/728] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:27.837388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:27.839525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:27.846588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:27.847072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:27.847535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:27.848229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:27.848683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:27.849227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:27.879194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d651a14d-c9dd-4250-ac53-eaa364f5829b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046863 Sep 19 11:30:27.879759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 367/729] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:28.157140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:28.159390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:28.166007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:28.166490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:28.168005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:28.168005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:28.168205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:28.168498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:28.198284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf6f2b50-c5aa-4d26-8616-fb9ef9a74143 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045178 Sep 19 11:30:28.202461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 363/730] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:28.892504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:28.894646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:28.901355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:28.901842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:28.902288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:28.902981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:28.903461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:28.903886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:28.934199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f511df75-992b-4e14-8888-5733d9d05cca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Sep 19 11:30:28.934766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 368/731] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:29.211094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:29.213234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:29.219943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:29.220429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:29.220869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:29.221570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:29.222070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:29.222458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:29.252970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e9800dce-910d-4a67-8258-2099d75e1662 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046824 Sep 19 11:30:29.253704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 364/732] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:29.947158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:29.949374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:29.955793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:29.956280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:29.956721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:29.957672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:29.958138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:29.958655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:29.987855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-79483037-338a-4bfa-b8a8-b9b2a9b84a5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Sep 19 11:30:29.988416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 369/733] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:30.266555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:30.268766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:30.275945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:30.276743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:30.277510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:30.278583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:30.279422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:30.280164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:30.312538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-401f5d0f-6e3b-4161-9361-c782057b7476 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050236 Sep 19 11:30:30.313100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 365/734] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:30.999739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:31.001964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:31.010678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:31.011193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:31.011680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:31.012404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:31.012860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:31.013288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:31.044096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-63adcaf6-8b2c-4abb-9b7d-772d0c09bebc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048447 Sep 19 11:30:31.044666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 370/735] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:31.326339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:31.328573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:31.335363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:31.335849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:31.336866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:31.337555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:31.338012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:31.338437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:31.368157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-30b08bad-a54d-4d8a-812b-fdf5b7be45c1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046134 Sep 19 11:30:31.368726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 366/736] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:32.057056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:32.059411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:32.066063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:32.066549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:32.066988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:32.067796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:32.068461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:32.068964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:32.100866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0be9980f-6efb-435c-b9a3-769d5bc1b1a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Sep 19 11:30:32.102483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 371/737] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:32.380896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:32.382992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:32.391052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:32.391557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:32.391998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:32.392693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:32.393153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:32.393636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:32.426114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7e094e42-76e7-4c42-b5f9-0aff267bbaa4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049237 Sep 19 11:30:32.426827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 367/738] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:33.113577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:33.115761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:33.122554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:33.123041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:33.123515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:33.124210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:33.124660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:33.125078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:33.155729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1589b6a4-a894-4a63-9a56-d5943f314700 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045704 Sep 19 11:30:33.156355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 372/739] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:33.439689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:33.441754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:33.448759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:33.449255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:33.449689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:33.450384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:33.450836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:33.451325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:33.484078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-94f1eed5-81c4-4013-b60b-2db1de545c06 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048541 Sep 19 11:30:33.488897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 368/740] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:34.168558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:34.171025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:34.179379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:34.181954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:34.182408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:34.183177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:34.183685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:34.184122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:34.216648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4163b06f-61d9-4fbe-975d-a29622ed888f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052603 Sep 19 11:30:34.217513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 373/741] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:34.496861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:34.499101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:34.505532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:34.506108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:34.506677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:34.507466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:34.508000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:34.508978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:34.541301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d40c3d0a-d5ad-4ca7-81db-714fcef2be0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049249 Sep 19 11:30:34.542249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 369/742] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:35.230843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:35.233028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:35.239730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:35.240214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:35.240648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:35.241345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:35.241798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:35.242218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:35.274488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e350702-845b-4091-8ec0-670caa80329c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048470 Sep 19 11:30:35.279969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 374/743] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:35.554107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:35.557384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:35.564302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:35.564791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:35.565233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:35.566062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:35.566543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:35.567000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:35.585864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:35.599777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-753ded6c-2dc9-4876-9996-69970de251c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049573 Sep 19 11:30:35.600361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 370/744] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:36.287535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:36.289754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:36.292224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=66 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:36.296981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:36.297469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:36.297906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:36.298605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:36.299058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:36.299513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:36.334266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7560b241-4275-4fbe-9804-0d085d832eba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050766 Sep 19 11:30:36.334852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 375/745] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:36.612628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:36.614826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:36.622312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:36.622807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:36.623308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:36.624011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:36.624466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:36.624890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:36.655944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f5514171-b0aa-4304-b1cb-081423f2c797 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047671 Sep 19 11:30:36.656533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 371/746] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:37.349501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:37.351801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:37.358228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:37.358711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:37.359149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:37.359865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:37.360328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:37.360759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:37.392450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d74941f-7cd7-4804-9975-1cc7c9fdefc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047345 Sep 19 11:30:37.393016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 376/747] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:37.668075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:37.670392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:37.672842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=70 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:37.678272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:37.678760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:37.679245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:37.681059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:37.682037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:37.682468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:37.716030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-daa1d1eb-e13c-4d3d-bbf7-fb9a599e3e3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052042 Sep 19 11:30:37.716729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 372/748] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:38.407905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:38.410021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:38.417201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:38.417691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:38.418133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:38.418833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:38.419397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:38.419959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:38.452932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d56b9ee8-479d-4c5a-98c8-2b6571139044 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049087 Sep 19 11:30:38.453846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 377/749] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:38.728570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:38.730732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:38.738115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:38.738654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:38.739052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:38.739771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:38.740236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:38.740668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:38.772681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cec1f46b-4f5d-423c-a04b-29d1a98e2c31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048563 Sep 19 11:30:38.773260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 373/750] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:39.465453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:39.467585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:39.474698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.475210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.475712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.476407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.476863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.477294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.481364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:39.507652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c810561f-5288-4794-8ca5-4dc318a10c0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046309 Sep 19 11:30:39.508629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 378/751] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:39.785873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:39.788085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:39.794654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.795391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.795834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.796550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.797001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.797424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.828293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-38a3ba86-5f99-4a37-ab12-42bd8c22894a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046334 Sep 19 11:30:39.828855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 374/752] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:39.938496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:39.938985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:39.946156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.946654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.947688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.948397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:39.948857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:39.949406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:39.979145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f49062d5-7898-4f55-9bf4-3dfe441cd3f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments/4186c97e-2ad1-45ce-b212-5fbe24a99966" status: 200 len: 194 microversion: 2.20 time: 0.044652 Sep 19 11:30:39.979771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 379/753] 10.222.0.78 () {60 vars in 1454 bytes} [Mon Sep 19 11:30:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments/4186c97e-2ad1-45ce-b212-5fbe24a99966 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:40.048377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:40.048799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:40.054756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.055276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.055714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.056910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.057362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.057786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.137826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lazy-loading 'services' on Instance uuid e7226154-6dfa-424f-b89e-fb320490d32c {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:40.357060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ae27a1fc-e392-4fbf-ae3f-0d32d0456f08 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments/4186c97e-2ad1-45ce-b212-5fbe24a99966" status: 202 len: 0 microversion: 2.20 time: 0.312469 Sep 19 11:30:40.357583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 375/754] 10.222.0.78 () {60 vars in 1457 bytes} [Mon Sep 19 11:30:40 2022] DELETE /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments/4186c97e-2ad1-45ce-b212-5fbe24a99966 => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:30:40.366447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:40.369295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:40.375506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.375993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.376642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.377381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.377819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.378245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.412062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-53918128-42ed-4ca6-879a-10632d7af271 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049589 Sep 19 11:30:40.412641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 380/755] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:40.520383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:40.522995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:40.529311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.529831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.530324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.531094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.531638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.532056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.561362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c807e93b-58e8-4b02-b8c7-787a8c17ea4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045358 Sep 19 11:30:40.561916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 376/756] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:40.840923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:40.843209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:40.849783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.850273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.850712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.851429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:40.851885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:40.852318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:40.883380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-516de205-bc33-48d4-8807-b03bfad63acd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046896 Sep 19 11:30:40.884213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 381/757] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:41.425785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:41.427954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:41.434903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.435423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.435861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.436549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.437003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.437424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.469061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0ba7f794-6e66-40bd-923b-40562a563ffa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047419 Sep 19 11:30:41.469624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 377/758] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:41.574049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:41.576251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:41.582457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.582951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.583413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.584105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.584557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.584981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.613249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e593757b-1d25-4e14-9a55-8dfd7dcfcee4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043732 Sep 19 11:30:41.613805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 382/759] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:41.897801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:41.900553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:41.906566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.911675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.911675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.911675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:41.911675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:41.912085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:41.940766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6f951958-700d-4aac-8970-14e124917ffc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046917 Sep 19 11:30:41.941338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 378/760] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:42.481706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:42.483803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:42.490170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.490646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.491080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.491783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.492233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.492648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.521921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-69aa6c9b-bce4-44b6-aae4-ec8cacbce668 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044837 Sep 19 11:30:42.522466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 383/761] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:42.625653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:42.627798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:42.634759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.635271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.635710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.636400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.636910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.637336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.667465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70f104d1-c972-4bc6-895b-52e182b6a834 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045747 Sep 19 11:30:42.668039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 379/762] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:42.953171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:42.955393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:42.961783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.962263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.962697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.963408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:42.963859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:42.964277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:42.994065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1c7cd960-8443-42f3-b618-be8230e0f664 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044300 Sep 19 11:30:42.994556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 384/763] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:43.534228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:43.536471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:43.542433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.542920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.543399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.544095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.544548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.544976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.575248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-53bd3abd-b484-4f0e-8f86-ba0abc14443f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044980 Sep 19 11:30:43.575818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 380/764] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:43.680326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:43.683040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:43.689615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.690094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.690530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.691239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:43.691694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:43.692116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:43.721636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1da154fe-b662-4743-9b33-9d27d7b34767 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045351 Sep 19 11:30:43.722193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 385/765] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:44.006120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:44.008314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:44.014886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.015409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.015860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.016587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.017072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.017501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.047450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-316cb9c5-6389-4a83-ad63-c4f7d68f255e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045311 Sep 19 11:30:44.048014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 381/766] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:44.588158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:44.590277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:44.596578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.597054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.597492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.598162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.598609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.599026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.627994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3845db24-b139-49aa-96d8-21bc5b72a523 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043809 Sep 19 11:30:44.628540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 386/767] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:44.734579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:44.736743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:44.742785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.743297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.744327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.745024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:44.745475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:44.745903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:44.775566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a5ecff43-79dd-4275-b59f-a10277efaf66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044957 Sep 19 11:30:44.776132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 382/768] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:45.060394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:45.062554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:45.068961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.069441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.069871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.070554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.070997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.071450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.100831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-693c3dc5-1d31-47da-9962-fbaf5caee619 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Sep 19 11:30:45.101391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 387/769] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:45.640939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:45.643054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:45.649439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.652716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.652716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.652716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.652716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.653073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.682105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b5c02ebd-7b5a-491e-8596-5282c8b42b48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045175 Sep 19 11:30:45.682661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 383/770] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:45.787977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:45.790165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:45.796634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.797112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.797543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.798232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:45.798686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:45.799111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:45.828804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b86b44b7-1d6b-4cb7-83af-e00f4e317b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044861 Sep 19 11:30:45.829382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 388/771] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:46.115044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:46.117369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:46.124723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.125252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.125782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.126506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.126957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.127398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.157503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-10153376-151a-411b-83b8-995c78878cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046914 Sep 19 11:30:46.158059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 384/772] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:46.694589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:46.696813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:46.703475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.703972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.704378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.705057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.705504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.705921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.736535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fab651a3-c80d-40da-9b78-ddd1f1e3f246 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045903 Sep 19 11:30:46.737094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 389/773] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:46.841345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:46.843535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:46.850153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.850561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.850999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.851732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:46.852188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:46.852615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:46.883915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7617185b-b2f5-401e-a0c8-2f39841054b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046996 Sep 19 11:30:46.884495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 385/774] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:47.171015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:47.173226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:47.179277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.179766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.180199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.181650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.181998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.182425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.211851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-308131cb-52a3-4c7b-87cd-2c3251dcc5e3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Sep 19 11:30:47.212409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 390/775] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:47.749453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:47.751624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:47.757582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.758068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.758507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.759215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.759673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.760099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.777867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:47.790866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cfa8088e-71db-4f2e-a646-867407da365f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045467 Sep 19 11:30:47.795812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 386/776] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:47.896919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:47.899238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:47.906808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.907331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.907767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.908463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:47.908917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:47.909336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:47.939452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dec5da62-d1be-4e09-b8b2-c01696402bbe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046835 Sep 19 11:30:47.940010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 391/777] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:48.224642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:48.226772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:48.234473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.234951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.235414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.236098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.236545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.236964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.266760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-309b3094-affc-46e6-a708-84e836f237ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Sep 19 11:30:48.267360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 387/778] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:48.802687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:48.804862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:48.811376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.811867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.812309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.813001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.813455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.813884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.843569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5273f7a8-6329-4a6f-860a-1c7f11874efc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044849 Sep 19 11:30:48.844127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 392/779] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:48.952418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:48.954548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:48.960653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.961126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.961556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.962238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:48.962688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:48.963106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:48.991264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3a042182-92c8-4293-8bce-22fa83381810 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043299 Sep 19 11:30:48.991815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 388/780] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:49.278535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:49.280695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:49.287328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.287851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.288295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.288994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.289488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.289918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.320443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-22b610aa-686d-4f6f-9b3d-6343e4f6692b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045939 Sep 19 11:30:49.321003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 393/781] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:49.857032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:49.859197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:49.865753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.866239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.866683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.867408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:49.867863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:49.868290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:49.897953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-151f92e1-e552-426c-94d4-cfc2f52954eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045635 Sep 19 11:30:49.898534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 389/782] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:50.004277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:50.006439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:50.013363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.013911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.014414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.015134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.015621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.016044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.041166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:50.045894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9c72c363-5ecc-439d-a9ba-8265fcad2778 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Sep 19 11:30:50.046466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 394/783] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:50.333395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:50.335596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:50.341523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.342010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.342450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.343137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.343636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.344063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.374072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c8a21f63-458b-4d9b-925a-2dbe5634bd74 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Sep 19 11:30:50.374557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 390/784] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:50.912830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:50.915056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:50.921870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.922349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.922782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.923496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:50.923945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:50.924363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:50.953592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-467cfac1-546a-4769-aa6a-9c80a6d951c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044829 Sep 19 11:30:50.954208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 395/785] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:51.058775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:51.061048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:51.067555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.068043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.068485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:51.069179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.069635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.070069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:51.101144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-369b84c4-6b52-430e-aaa5-0bdce2885135 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046986 Sep 19 11:30:51.101727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 391/786] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:51.387246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:51.389420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:51.395463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.395947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.396381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:51.397076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.397522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.398010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:51.429682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-61e5b61e-31a2-42b0-b0ff-4f64766c1cbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047058 Sep 19 11:30:51.430307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 396/787] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:51.966216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:51.968387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:51.974480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.974967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.975439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:51.976140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:51.976593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:51.977040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.009680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d2043426-f98b-4caf-80cd-350a96d99d61 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047476 Sep 19 11:30:52.010366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 392/788] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:52.114146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:52.116410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:52.123656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.124151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.124597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.125288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.125769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.126185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.155641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a8e294d4-42c9-4e92-8941-8e7c929e2474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045511 Sep 19 11:30:52.156225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 397/789] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:52.314378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:52.314980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:52.321528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.322018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.322453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.323681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.324143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.324569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.349581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-37efa712-960f-46c5-b911-747eba3ee85b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859/ips" status: 200 len: 145 microversion: 2.1 time: 0.039149 Sep 19 11:30:52.350160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 393/790] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 11:30:52 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:52.442389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:52.444770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:52.451422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.453543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.453990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.454875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:52.455523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:52.458064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:52.498294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d0294613-0230-4605-8132-729fbbb86058 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059753 Sep 19 11:30:52.498869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 398/791] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:53.023345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:53.025576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:53.031632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.032127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.032571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.033266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.033726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.034229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.070382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7ddd0d14-82bb-459b-9267-abd249094a88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051210 Sep 19 11:30:53.070959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 394/792] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:53.169182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:53.171305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:53.181746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.182252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.183333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.184035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.184485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.184900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.215534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1eedd653-6001-4a8b-b468-d457ea6d5f27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050846 Sep 19 11:30:53.216107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 399/793] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:53.510081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:53.512868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:53.519325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.519815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.520251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.520941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:53.521398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:53.521831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:53.553306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c429ec21-23c4-4f11-81d8-fd468aad6b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047164 Sep 19 11:30:53.553887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 395/794] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:54.082717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:54.084868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:54.091038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:54.091549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:54.091980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:54.092666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:54.093115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:54.093535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:54.123598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9ec2801b-ca2d-4a3b-8d77-e9f8f5edd4f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045083 Sep 19 11:30:54.124165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 400/795] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:54.228254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:54.230374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:54.236322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:54.236809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:54.237249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:54.237948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:54.238405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:54.238836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:54.268483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a343d0d5-dee2-4377-b24b-8188dc8a195d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Sep 19 11:30:54.269044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 396/796] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:54.565879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:54.568032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:54.574549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:54.575033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:54.575500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:54.576299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:54.576754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:54.577174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:54.606649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1b249bae-c9fc-44de-929f-18d87ba9ac14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Sep 19 11:30:54.607221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 401/797] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:55.137008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:55.139158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:55.145561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.146036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.146467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.147145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.147637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.148081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.177695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e1b3a507-8962-48cd-a5a3-1c50d40a16bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045165 Sep 19 11:30:55.178259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 397/798] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:55.281733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:55.283926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:55.289848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.290324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.290754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.291467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.291915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.292334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.321120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-31837fc2-0ea9-4bd1-92b5-01dd01adbcbc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Sep 19 11:30:55.321678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 402/799] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:55.620750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:55.622891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:55.628847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.629331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.629768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.630457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:55.630910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:55.631363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:55.661425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2d40c7c0-ea44-40c1-8edd-025793b7489e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046143 Sep 19 11:30:55.664524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 398/800] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:56.190693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:56.192865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:56.199258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.200841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.200841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.200841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.201265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.201690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.231277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3f8c6528-67a6-4c0d-b098-df9267ae157a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044553 Sep 19 11:30:56.231834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 403/801] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:56.334390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:56.336509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:56.343459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.343944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.344382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.345075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.345529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.345957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.377063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3d10c609-ef90-4775-afac-b0d8c751ad53 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046960 Sep 19 11:30:56.377635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 399/802] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:56.674898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:56.677007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:56.683687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.684166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.684597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.685311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:56.685771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:56.686188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:56.715453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e5916d7-ef24-4051-8355-792d199b88a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 Sep 19 11:30:56.716013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 404/803] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:57.244165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:57.246395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:57.252301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:57.252825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:57.253220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:57.253909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:57.254362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:57.254787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:57.283812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3e8781ec-86a8-4744-9a78-8fb24911bf9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043607 Sep 19 11:30:57.284364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 400/804] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:57.390955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:57.392952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:57.399932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:57.400422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:57.400850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:57.402180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:57.402625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:57.403045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:57.432279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-409b4de7-81cf-401f-bf34-2db64938771a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046408 Sep 19 11:30:57.432846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 405/805] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:57.728373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:57.730447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:57.736858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:57.737347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:57.737869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:57.738561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:57.739018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:57.739473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:57.768764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-192b854a-7436-4e21-9fc1-09cdfa538a66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Sep 19 11:30:57.769321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 401/806] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:58.296910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:58.299261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:58.305218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:58.305708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:58.306151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:58.306846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:58.307990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:58.308438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:58.337892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23bc82a6-c81c-4e3b-aa92-78e4d2e857a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045003 Sep 19 11:30:58.338474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 406/807] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:30:58.444956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:58.447120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:58.453184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:58.453656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:58.454083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:58.454773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:58.455258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:58.455679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:58.485866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-689148ce-ae39-4a63-8201-18467e9e56eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044882 Sep 19 11:30:58.486434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 402/808] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:30:58.781978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:58.784193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:58.790597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:58.791083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:58.791557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:58.792856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:58.793321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:58.793746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:58.822799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4cdbb851-a967-413f-9d55-068143554149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Sep 19 11:30:58.823446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 407/809] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:59.000097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:30:59.000664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:59.007028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.007540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.007976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.008659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.009109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.009560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.026957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:30:59.040092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lazy-loading 'flavor' on Instance uuid ba241cb3-089a-4eef-a681-bddf2cb387bd {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:30:59.350826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:59.353054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:59.359032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.359561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.360005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.360716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.361172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.361288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1ec59da-570b-4f63-8a81-ed2d09290de2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "POST /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd/action" status: 202 len: 0 microversion: 2.1 time: 0.364821 Sep 19 11:30:59.361628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.362165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 403/810] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:30:58 2022] POST /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd/action => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:30:59.373572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:59.378589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:59.380791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.381294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.381736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.382439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.382896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.383389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.395235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b62350b5-b833-4512-8bb1-b84b3d74a93c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048446 Sep 19 11:30:59.395832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 408/811] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:30:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:30:59.498741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:59.500985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:59.506909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.507444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.507882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.508577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.509034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.509483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.531802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:30:59.539603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5883ae98-35d2-49e6-b397-68746707f378 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045355 Sep 19 11:30:59.539805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e36d0c8a-3b7e-422e-8e9c-c5961b75e912 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.172170 Sep 19 11:30:59.540371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 409/812] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:30:59.540621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 404/813] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:30:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:30:59.835263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:30:59.837435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:30:59.843886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.844377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.844818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.845530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:30:59.845973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:30:59.846400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:30:59.876836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6bf607e4-b11f-42db-b178-c007c331ed19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Sep 19 11:30:59.877409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 410/814] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:30:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:00.408333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:00.410387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:00.417526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.418035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.418474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.419197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.419650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.420078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.450095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0f3e6a39-02a9-4cda-bb65-d29ee6e17ad1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045907 Sep 19 11:31:00.450653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 405/815] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:00.552869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:00.555097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:00.564923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.565630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.565793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:00.566073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.566283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:00.566786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.567267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.567695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.572522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.573012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.573603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.574332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.574785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.575231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.585793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:00.598738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ae3f0123-3427-4687-9ec8-320741611ad7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049834 Sep 19 11:31:00.599338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 411/816] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:00.704220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:00.712468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b9e19d89-c623-4909-899f-eadeab8e90e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150624 Sep 19 11:31:00.713037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 406/817] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:00.889779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:00.902688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:00.902688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.902688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.902688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.903117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:00.903117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:00.903117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:00.933721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b1894f73-d0ca-4f9c-96a1-95d63c3df8dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048317 Sep 19 11:31:00.934292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 412/818] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:01.462457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:01.465265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:01.471928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.472407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.472841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.473532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.473993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.474411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.509528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f2d028bd-9d0a-4272-8c52-cce2578ee874 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050944 Sep 19 11:31:01.510107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 407/819] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:01.610985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:01.613159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:01.619743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.620227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.621202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.621916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.622366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.622785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.654753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e3c2c71a-b1ad-4c7b-8cc9-4e48f31a1d57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047851 Sep 19 11:31:01.655361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 413/820] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:01.735422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:01.736037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:01.742242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.742733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.743198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.743899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.744357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.744788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.877615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:01.885666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-60cf75a9-7e45-496e-a600-6ec427516b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154101 Sep 19 11:31:01.886762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 408/821] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:01.946314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:01.948568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:01.955836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.956316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.957003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.957696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:01.958143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:01.958561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:01.989053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a75578f0-c6c9-4a66-b204-e6f7241f6854 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046802 Sep 19 11:31:01.989610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 414/822] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:02.522091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:02.524304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:02.531242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.531728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.532162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:02.532852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.533306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.533730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:02.563181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-67b778e5-bfcc-4cfa-8bfd-1a8da9074694 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045139 Sep 19 11:31:02.563748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 409/823] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:02.667402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:02.669471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:02.675512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.676050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.676486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:02.677201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.677652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.678106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:02.706864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54abef75-e626-4239-845d-3fbb99e251e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043343 Sep 19 11:31:02.707469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 415/824] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:02.909690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:02.910296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:02.916269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.916754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.917196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:02.917935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:02.918344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:02.918766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.003106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:03.005487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:03.012624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:03.013143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:03.013578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.014266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:03.014721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:03.015145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.045342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-72970289-e7eb-47ad-bf39-4dab031703a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046343 Sep 19 11:31:03.045920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 416/825] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:03.051812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:03.060178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3baa7bcd-e988-43fa-a933-353f4d746d10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154409 Sep 19 11:31:03.060744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 410/826] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:03.576025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:03.578194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:03.584600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:03.585081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:03.585516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.586203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:03.586661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:03.587082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.617991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-59bbb746-a1fd-4696-8e0c-c46ef1ea9bfc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046046 Sep 19 11:31:03.618567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 417/827] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:03.719469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:03.721553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:03.728326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:03.728840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:03.729276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.730482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:03.730937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:03.731389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:03.760358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dc2eab59-89ba-4d0f-8cc1-583fad09e554 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Sep 19 11:31:03.760922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 411/828] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:04.058257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:04.060441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:04.067094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.067630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.068072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.068767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.069233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.069662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.083918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:04.084524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:04.090837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.091346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.091778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.092468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.092925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.093345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.100439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f192ed4d-a7c1-4aeb-bc60-c36093159c78 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046207 Sep 19 11:31:04.101006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 418/829] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:04.227695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:04.235593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3b3d184f-e4cc-47b9-bd3f-2bf9e7f0154d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155744 Sep 19 11:31:04.236160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 412/830] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:04.631658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:04.633791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:04.640375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.640861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.641296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.641977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.642427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.642845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.672525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d18fd44c-9a95-41f1-b59f-0b466dc387a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044897 Sep 19 11:31:04.673096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 419/831] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:04.772700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:04.774845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:04.781410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.781895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.782334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.783025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:04.783512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:04.783947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:04.813463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b712fee0-0934-4645-a826-3be1918149e5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044703 Sep 19 11:31:04.814020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 413/832] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:05.113811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:05.116033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:05.122496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.122983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.123474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.124175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.124630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.125059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.155039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-32b14e2a-ea76-4c3d-97eb-f81f4548ad4a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Sep 19 11:31:05.155632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 420/833] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:05.259154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:05.259790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:05.268296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.268779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.269214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.269908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.270368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.270793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.408052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:05.415991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-58305352-353f-4215-9885-cd09a2b45353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.162000 Sep 19 11:31:05.416681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 414/834] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:05.685397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:05.687588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:05.693491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.693967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.694397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.695076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.695549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.695970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.726374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9db1d5b7-0b30-4f6b-889d-452632eda4da tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044998 Sep 19 11:31:05.726933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 421/835] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:05.826633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:05.828692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:05.834922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.835444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.835874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.836561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:05.837007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:05.837426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:05.866365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aec17d0d-b15c-4851-9eb2-58e10c055f35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044260 Sep 19 11:31:05.866917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 415/836] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:06.167064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:06.179090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:06.179090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.179090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.179090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.179531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.179531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.179531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.209023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-31fd4dd6-80a9-41f1-841e-45abca56ef1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Sep 19 11:31:06.210412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 422/837] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:06.440497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:06.441136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:06.447619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.448108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.448554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.449247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.449703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.450127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.581992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:06.590183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-39564f28-74aa-4204-9220-5131d4718249 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153591 Sep 19 11:31:06.590909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 416/838] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:06.739307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:06.741492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:06.748150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.748625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.749045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.749735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.750182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.750599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.779978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-58141f94-bcd0-4bd4-b030-6f2b8b2133a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044786 Sep 19 11:31:06.780541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 423/839] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:06.879132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:06.881314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:06.887462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.887952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.888391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.889088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:06.889543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:06.889970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:06.920113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-23916ed5-6a36-460b-80ed-f71de9ef4d5e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Sep 19 11:31:06.920679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 417/840] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:07.221787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:07.223940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:07.230389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.230864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.231431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.232112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.232563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.232982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.262510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7f400840-5d1d-4067-ade0-77d3277f55fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044701 Sep 19 11:31:07.263059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 424/841] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:07.616131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:07.616736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:07.623787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.624268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.624701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.625390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.625843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.626273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.630442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:07.761666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:07.769975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f3d31691-6535-4b99-8d40-b2ccc73b2467 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157711 Sep 19 11:31:07.770537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 418/842] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:07.792560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:07.794753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:07.796677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:07.801435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.801868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.802308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.802999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.803490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.803919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.834333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-360af97a-526c-4476-8e6a-95a199782938 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045721 Sep 19 11:31:07.834896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 425/843] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:07.935588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:07.937814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:07.945697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.946204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.946652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.947400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:07.947866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:07.948311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:07.979903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d0c258a0-50a7-498d-8a58-7ebe63804ca0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050450 Sep 19 11:31:07.980471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 419/844] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:08.275868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:08.278628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:08.285971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.286458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.286902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:08.287637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.288099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.288525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:08.319629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f504f46f-bf01-46af-bdc6-a971c443038d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048155 Sep 19 11:31:08.320205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 426/845] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:08.793170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:08.794287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:08.796568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=96 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:08.801258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.801812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.802274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:08.802984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.803465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.803895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:08.845929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:08.848116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:08.854203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.854687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.855124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:08.856973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:08.857430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:08.857858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:08.888250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ec4cd7ba-3cfb-484f-88c9-bd889eee53a7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046197 Sep 19 11:31:08.888832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 427/846] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:08.939391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:08.947364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4770eb40-392b-4463-a3fb-9a86da6a3302 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158329 Sep 19 11:31:08.947930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 420/847] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:08.993695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:08.996089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:09.002789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.003430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.003880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.004774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.005208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.005880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.010537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:09.038200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ddfe6df5-7226-443a-88f0-395f33d034b4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048716 Sep 19 11:31:09.038761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 428/848] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:09.332121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:09.334248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:09.340418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.341408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.341954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.342683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.343149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.343615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.372318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a023b612-d489-4c81-91ec-b225c53545b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044448 Sep 19 11:31:09.372865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 421/849] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:09.901292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:09.904059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:09.910216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.910708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.911144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.911897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.912352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.912813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.943371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-785f9b99-05d5-44e2-bf3e-fed1d46fbbbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046406 Sep 19 11:31:09.943950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 429/850] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:09.970287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:09.970899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:09.977543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.978038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.978476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:09.979278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:09.979661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:09.980108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.050808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:10.053000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:10.059390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.059888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.060328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.061030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.061595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.062033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.093041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-74981097-4bdc-49f6-9bb0-d6b40da329ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046329 Sep 19 11:31:10.093809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 430/851] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:10.161583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:10.169678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d1f37bd9-2b37-4e53-a873-44cc7d445ffa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.203221 Sep 19 11:31:10.170268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 422/852] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:10.384745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:10.386919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:10.393648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.394134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.394586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.395307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.395767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.396194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.426460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bf40b46b-9c19-4e56-bf3e-485d2d46f7ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045698 Sep 19 11:31:10.427028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 431/853] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:10.957022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:10.959229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:10.965405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.965893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.966320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:10.967012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:10.967629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:10.968054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.003316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cdb0ef17-1e3a-44ef-b8de-1924020da0b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050507 Sep 19 11:31:11.003974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 423/854] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:11.105547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:11.108337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:11.115113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.119290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.119290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.119290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.119290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.120372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.147431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-04b2b001-7c0d-4340-a5b4-edba7fafed51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Sep 19 11:31:11.148098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 432/855] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:11.202755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:11.203376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:11.209515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.209993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.210424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.211104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.211581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.211996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.343108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:11.350741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d57b50b8-0646-4efe-9bc2-d61d81ce3f82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151842 Sep 19 11:31:11.351314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 424/856] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:11.439427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:11.441604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:11.447661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.448152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.448594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.449286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:11.449744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:11.450186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:11.480975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-29e6e812-0dc8-4c36-b7b2-6ada1cfebe30 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045588 Sep 19 11:31:11.482149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 433/857] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:12.016753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:12.018837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:12.026488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.026984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.027464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.028206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.028663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.029110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.060181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3399275d-ad7b-44cb-904a-63c11f824ddd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047549 Sep 19 11:31:12.060762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 425/858] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:12.160921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:12.163309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:12.169946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.170656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.171111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.171845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.172304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.172736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.203925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a9c6a01b-7b74-4e17-9692-e1cf011dd299 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Sep 19 11:31:12.204500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 434/859] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:12.374761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:12.375333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:12.381165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.381645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.382075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.382760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.383244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.383673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.494512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:12.496824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:12.502987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.504859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.504859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.504859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:12.505160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:12.505492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:12.514061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:12.522452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6a5346c3-fd65-48cf-9273-f4e080bd1bcd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151597 Sep 19 11:31:12.523025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 426/860] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:12.536159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fbc0071b-2917-4f22-910c-ab0649a21e63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045726 Sep 19 11:31:12.536723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 435/861] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:13.072658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:13.075423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:13.082451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.082936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.083402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.084106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.084556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.084978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.115846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-60217d52-d3c8-49f4-bf80-1111da54e79f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047102 Sep 19 11:31:13.117300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 427/862] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:13.218034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:13.223205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:13.227020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.227540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.228026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.228733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.229308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.229618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.259613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f519c430-86d4-401b-a585-3e7917437182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046665 Sep 19 11:31:13.260179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 436/863] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:13.547463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:13.548080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:13.549078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:13.551304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:13.554182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.554677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.555120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.555854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.556320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.556748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.557185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.557680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.558122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.558816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:13.559311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:13.559738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:13.589415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-92237609-0426-46be-abf3-04e7b34a2600 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044218 Sep 19 11:31:13.589999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 437/864] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:13.693159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:13.700974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-110cbb22-58e5-4bcb-9435-8f8efc61d738 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158260 Sep 19 11:31:13.701548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 428/865] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:14.128445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:14.130590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:14.136575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.137056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.137499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.138190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.139155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.139612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.169899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-702f6d4d-4cca-4f98-b62c-46bf870eaf7d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045393 Sep 19 11:31:14.170467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 438/866] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:14.272005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:14.274213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:14.280993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.281479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.281916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.282609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.283069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.283527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.312607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d6cfac22-ac16-4b0c-8f4e-273073035990 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Sep 19 11:31:14.313180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 429/867] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:14.602734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:14.605057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:14.611531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.612019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.612459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.613154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.613609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.614041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.646768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b589991d-9446-4f5a-af45-d53744d7ffd8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048013 Sep 19 11:31:14.647432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 439/868] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:14.725028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:14.725663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:14.731617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.732096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.732526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.733208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:14.733659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:14.734082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:14.862086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:14.869941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e55fe18b-9ae7-420d-b717-dd05642798d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.148830 Sep 19 11:31:14.870510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 430/869] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:15.182734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:15.184919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:15.191550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.192038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.192483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.193177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.193637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.194064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.225120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fdca408c-927e-4fe5-a836-98d83de4799d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046397 Sep 19 11:31:15.225680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 440/870] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:15.325238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:15.327931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:15.334510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.334983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.335441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.336123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.336569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.336988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.367407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-26a2de8a-ecaa-4fd9-9f1c-0961ddef4db6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046038 Sep 19 11:31:15.367878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 431/871] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:15.636417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-917022c3-9581-432b-b123-e62232240313 req-459e4467-05b4-4d4e-97fe-d941ec7bbdd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba241cb3-089a-4eef-a681-bddf2cb387bd", "name": "network-vif-unplugged", "status": "completed", "tag": "96003a8a-4fc4-452c-bf1a-dded308d6faa"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:31:15.646423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-917022c3-9581-432b-b123-e62232240313 req-459e4467-05b4-4d4e-97fe-d941ec7bbdd5 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.646943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-917022c3-9581-432b-b123-e62232240313 req-459e4467-05b4-4d4e-97fe-d941ec7bbdd5 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.647435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-917022c3-9581-432b-b123-e62232240313 req-459e4467-05b4-4d4e-97fe-d941ec7bbdd5 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.659901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:15.660109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-917022c3-9581-432b-b123-e62232240313 req-459e4467-05b4-4d4e-97fe-d941ec7bbdd5 service nova] Creating event network-vif-unplugged:96003a8a-4fc4-452c-bf1a-dded308d6faa for instance ba241cb3-089a-4eef-a681-bddf2cb387bd on hv-cinder-82282 Sep 19 11:31:15.662052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:15.665199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-917022c3-9581-432b-b123-e62232240313 req-459e4467-05b4-4d4e-97fe-d941ec7bbdd5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.085184 Sep 19 11:31:15.665999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 441/872] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:15.668512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.668884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.669282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.670118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.670582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.670989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.702171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-316e3856-5a72-4fcf-87b2-58ff0d9c93f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045647 Sep 19 11:31:15.702743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 432/873] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:15.894263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:15.894959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:15.901635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.902145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.902636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:15.903500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:15.903954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:15.904940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:16.040359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:16.048938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1f0b3a9e-881b-46d7-8f0e-259b3f47c8b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159501 Sep 19 11:31:16.049517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 442/874] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:16.238131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:16.240215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:16.246158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:16.246634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:16.247065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:16.247780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:16.248228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:16.248648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:16.277649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-73488d1f-4d73-46e4-b620-1a4b390f3b9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043584 Sep 19 11:31:16.278197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 433/875] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:16.380638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:16.382927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:16.389307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:16.389794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:16.390245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:16.390988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:16.391472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:16.391902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:16.422304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-81e340a2-b468-4225-b88b-6b26edaae4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045773 Sep 19 11:31:16.422879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 443/876] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:16.714804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:16.717473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:16.724031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:16.724462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:16.724862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:16.725559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:16.726011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:16.726441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:16.752260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:16.757078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-28ec34fa-d7b1-4968-be5b-8afd5df4ddaa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046287 Sep 19 11:31:16.757590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 434/877] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:17.072374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:17.072990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:17.079989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.080475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.080915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.081938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.082403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.082856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.213741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:17.221474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f875a3f6-7e12-454a-bac5-2283a77bda6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153016 Sep 19 11:31:17.222047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 444/878] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:17.291192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:17.293360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:17.299739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.300160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.300605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.301296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.301748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.302176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.332340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-538fa75a-2416-4e40-84e8-7d92c213ce73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045175 Sep 19 11:31:17.332902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 435/879] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:17.434412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:17.437185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:17.443476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.443968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.444404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.445101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.445563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.445996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.464314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:17.477611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-705d85d0-bea1-4d56-8e76-7a4b51de3a51 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047297 Sep 19 11:31:17.478571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 445/880] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:17.769678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:17.771942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:17.778407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.778884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.779439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.780155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:17.780605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:17.781025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:17.810103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aaa7feae-9f8b-48f6-bb8d-e561358e0462 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044567 Sep 19 11:31:17.811231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 436/881] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:18.245209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:18.245813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:18.252335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.252858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.253301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.253998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.254461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.254891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.345645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:18.347825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:18.353779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.354277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.354719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.355451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.355909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.356343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.384514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:18.385513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-351007b9-5dda-43c3-9cb0-e51a84fa3bb7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044533 Sep 19 11:31:18.386100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 437/882] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:18.393064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c206f9eb-d1d0-4b70-9ef9-ffac43d281d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152155 Sep 19 11:31:18.393625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 446/883] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:18.489465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:18.491706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:18.497664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.498217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.498660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.499385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.499845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.500273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.530406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3e3b1da4-891b-4056-b835-1a2e333362b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044883 Sep 19 11:31:18.530972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 438/884] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:18.822693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:18.824863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:18.831276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.831766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.832205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.832896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:18.833360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:18.833788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:18.865245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f8302a56-89aa-4476-8268-784578fbad4d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046530 Sep 19 11:31:18.865808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 447/885] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:19.398503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:19.400612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:19.407711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.408189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.408626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.409308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.409757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.410215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.416717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:19.417333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:19.423864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.424361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.424802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.425499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.425957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.426385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.440246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d8cf2792-7887-407b-9c7a-6ad1033dd895 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045870 Sep 19 11:31:19.440813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 439/886] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:19.542475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:19.544693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:19.550560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.551047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.551522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.552224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.552680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.553112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.559513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:19.567830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6f8e4eb2-b519-4464-8dc5-ae89a91ed894 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154979 Sep 19 11:31:19.568625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 448/887] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:19.584296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5114867d-0d6b-4d3f-9662-25d5a40f1796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045825 Sep 19 11:31:19.584858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 440/888] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:19.877842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:19.879996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:19.885953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.886434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.886866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.887610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:19.888058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:19.888986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:19.918452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9a1620d9-540a-48b9-9af6-78a44a66fbb7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044525 Sep 19 11:31:19.918997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 449/889] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:20.452916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:20.455157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:20.461897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.462380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.462819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.463534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.463984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.464410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.495643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-baabce0d-165f-4341-9872-22fb697e9518 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046674 Sep 19 11:31:20.496208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 441/890] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:20.592141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:20.592819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:20.595931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:20.598074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:20.600029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.600511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.600943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.601621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.602070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.602490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.604001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.604482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.604918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.605605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.606059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.606482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.635550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-316b6f27-9a27-4e14-863f-4087b17083ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043894 Sep 19 11:31:20.636296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 442/891] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:20.750800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:20.758481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c72452d6-8588-4104-b0da-e5f30118da88 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.170240 Sep 19 11:31:20.759049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 450/892] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:20.931080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:20.933311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:20.939859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.940353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.940794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.941496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:20.941952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:20.942377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:20.972967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-de257655-038e-4a86-a4fe-b803a4e18ccd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045842 Sep 19 11:31:20.973556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 443/893] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:21.508459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:21.510597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:21.517148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.517627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.518056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:21.518765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.519237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.519659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:21.548609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-46b53d84-ff4e-437b-994b-3cd940fe96e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Sep 19 11:31:21.549154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 451/894] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:21.648866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:21.651043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:21.658076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.658550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.658983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:21.659698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.660142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.660559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:21.690001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-61398ee0-0083-44ba-8c5c-37367bc16cda tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Sep 19 11:31:21.690551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 444/895] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:21.783163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:21.783803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:21.790140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.790627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.791074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:21.791802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.792262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.792695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:21.926393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:21.934217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d67a46e3-51f1-4ebe-9e59-93a3421d5c07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155610 Sep 19 11:31:21.934793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 452/896] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:21.986561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:21.988751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:21.994874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.995415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.995856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:21.996556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:21.997016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:21.997439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:22.028265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9c021772-54c2-42a5-a481-a0a0b00b1271 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046329 Sep 19 11:31:22.028837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 445/897] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:22.561202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:22.563858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:22.569886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:22.570377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:22.570817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:22.571536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:22.572003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:22.572431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:22.602075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4b7d3ee2-cb10-433c-85eb-bce42fbcb584 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044871 Sep 19 11:31:22.602640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 453/898] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:22.703039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:22.705296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:22.711951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:22.712446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:22.712888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:22.713577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:22.714033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:22.714465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:22.744781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9dd7c34a-5d87-4003-8dac-d788314a0732 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046340 Sep 19 11:31:22.745346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 446/899] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:22.957743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:22.958286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:22.964583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:22.965057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:22.965485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:22.966287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:22.966789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:22.967226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:23.041561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:23.043912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:23.050353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:23.050852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:23.051318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:23.052086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:23.052508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:23.052910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:23.084425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a94a493a-1e31-4223-8c74-ea82b603693e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Sep 19 11:31:23.085203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 447/900] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:23.101621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:23.109507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-52853033-aa36-4593-8e4e-a251e364bfe9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156520 Sep 19 11:31:23.110271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 454/901] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:23.614512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:23.616817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:23.622868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:23.623389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:23.623823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:23.624511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:23.624955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:23.625379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:23.655628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-05befa3a-236c-49c6-9daa-12308f6700bb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045080 Sep 19 11:31:23.656434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 448/902] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:23.759283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:23.761453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:23.768909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:23.769392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:23.769858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:23.770544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:23.770995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:23.771451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:23.803395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cdcb3374-5975-4da2-8690-bd90d033bd08 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048011 Sep 19 11:31:23.803959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 455/903] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:24.097612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:24.099866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:24.106363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.106854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.107330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.108182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.108501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.108963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.131936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:24.132644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:24.138924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.139440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.139855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ccc5267d-b2ac-43f1-8332-5de732001690 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046759 Sep 19 11:31:24.139970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.140439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 449/904] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:24.140617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.140979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.141393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.273908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:24.281588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-65caa840-1b02-4e76-a8b4-3193e71a9f31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153454 Sep 19 11:31:24.282162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 456/905] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:24.669393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:24.671554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:24.677491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.677978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.678414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.679107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.679593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.680024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.711707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b9122576-fbae-44ad-b97b-e22b95c8e9a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046287 Sep 19 11:31:24.712306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 450/906] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:24.816217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:24.818376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:24.824542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.825022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.825458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.826133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:24.826584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:24.827003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:24.855929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-afec6124-8fbb-4ed8-8514-11877884cfca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Sep 19 11:31:24.856484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 457/907] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:25.152665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:25.154856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:25.161421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.161910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.162353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.163055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.163542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.164045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.181032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:25.194888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9ce51178-ad3d-4b02-8a64-284bf488e473 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046265 Sep 19 11:31:25.195960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 451/908] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:25.305553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:25.306135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:25.312577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.313063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.313498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.314189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.315262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.315693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.447680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:25.455518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-110528f6-07d4-4b1b-aec5-1927c57597cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153859 Sep 19 11:31:25.456373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 458/909] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:25.724566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:25.726703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:25.733217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.733703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.734144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.734834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.735326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.735755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.769665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b348ab3d-4c33-460d-a3ed-2e548bdd132b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049639 Sep 19 11:31:25.770241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 452/910] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:25.868601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:25.870777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:25.876949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.877372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.877813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.878494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:25.878947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:25.879404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:25.908392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd6c4d96-55c2-4d2b-8c49-a77f51f72fb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043783 Sep 19 11:31:25.909538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 459/911] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:26.208432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:26.210553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:26.217114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.217592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.218024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.218711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.219162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.220562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.250993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4a4a9172-8a50-4a92-b051-e17add5b2cfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046999 Sep 19 11:31:26.251588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 453/912] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:26.479808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:26.480413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:26.487698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.488405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.489175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.490370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.490981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.491447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.636238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:26.645308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1ab45eb8-d17f-4662-849b-83b8ad06d1ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.169398 Sep 19 11:31:26.645897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 460/913] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:26.788625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:26.791997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:26.798344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.798831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.801310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.801310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.801310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.801310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.836893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-00895963-386d-44a2-bbb3-d6c612b667ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056700 Sep 19 11:31:26.837461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 454/914] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:26.921516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:26.923715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:26.929974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.930629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.931146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.931900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:26.932391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:26.932819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:26.963558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-105ec296-ecfb-44b6-96ed-83398f18fd36 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046017 Sep 19 11:31:26.964110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 461/915] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:27.263055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:27.265243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:27.271651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.272128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.272559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:27.273246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.273691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.274110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:27.303082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e4cb65bf-a5e7-47d1-96af-a63e7ed7a91b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044076 Sep 19 11:31:27.303663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 455/916] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:27.668613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:27.669233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:27.676259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.676748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.677186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:27.677890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.678338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.678772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:27.682691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:27.810618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:27.818514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8db3987b-764f-4802-94b4-277bada5c989 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153829 Sep 19 11:31:27.819094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 462/917] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:27.849109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:27.851258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:27.857229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.857712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.858152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:27.858846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.859335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.859765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:27.889258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f060e57f-ea0d-4acb-a54e-549ba98c246a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044564 Sep 19 11:31:27.889815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 456/918] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:27.976790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:27.978925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:27.984889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.985366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.985797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:27.986475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:27.986972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:27.991769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:28.017858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a9ac25ae-3a19-4605-b41d-9dcfa2d6c1b8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Sep 19 11:31:28.018946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 463/919] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:28.316087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:28.318252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:28.324631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:28.325118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:28.325558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:28.326260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:28.326717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:28.327145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:28.357465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9837554a-3756-4f45-bdf7-6805720df25d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Sep 19 11:31:28.358031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 457/920] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:28.841823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:28.842440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:28.848933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:28.849425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:28.849866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:28.850558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:28.851021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:28.851473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:28.901664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:28.903956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:28.910204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:28.910795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:28.911335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:28.912275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:28.912805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:28.913238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:28.945117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4366903-2d52-4c8f-abc4-0598622a00fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047533 Sep 19 11:31:28.945705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 458/921] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:28.984342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:28.992681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87ff440e-8ac4-47d8-b758-cee0366d282b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154700 Sep 19 11:31:28.993252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 464/922] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:29.030076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:29.032226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:29.038195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:29.038673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:29.039104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:29.039853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:29.040307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:29.040722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:29.071070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b7274432-fe9e-4077-b867-4fdb5e4284b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044904 Sep 19 11:31:29.071673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 459/923] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:29.369769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:29.371901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:29.378472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:29.378988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:29.379459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:29.380160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:29.380619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:29.381088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:29.409881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ea7f7ef3-e2d7-40d7-8a9c-46f025710cf5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044128 Sep 19 11:31:29.410453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 465/924] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:29.958770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:29.960933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:29.967497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:29.967987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:29.968427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:29.969117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:29.969570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:29.969998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:29.999370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb0c697e-98d7-4166-ab37-b4c538ddda73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045269 Sep 19 11:31:29.999939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 460/925] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:30.016094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:30.016697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:30.023670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:30.024260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:30.025023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:30.026104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:30.026566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:30.026990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:30.084427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:30.086723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:30.092743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:30.093305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:30.093752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:30.094443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:30.094892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:30.095352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:30.126019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bffaeb97-9667-40f3-bf70-896ea0284486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046301 Sep 19 11:31:30.126596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 461/926] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:30.162906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:30.170677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5760b33b-dfaa-4f53-8417-ee72cfee679e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158396 Sep 19 11:31:30.171270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 466/927] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:30.422692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:30.424936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:30.430851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:30.431377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:30.431817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:30.432506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:30.432963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:30.433390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:30.463367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-084ec9b1-255d-4598-841f-9b475c242f82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044847 Sep 19 11:31:30.463924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 462/928] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:31.012225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:31.014408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:31.020878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.021454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.021768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.022447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.022894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.023351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.055195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54587149-2365-45f4-bbc2-7d12fd57d7bf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047089 Sep 19 11:31:31.055769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 467/929] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:31.138168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:31.140364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:31.146940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.147468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.147916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.148612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.149074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.149503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.179445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ed658cfc-1fc8-4ba9-a5dc-17de3038133f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Sep 19 11:31:31.179929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 463/930] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:31.199447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:31.200479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:31.206526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.207034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.207533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.208223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.208682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.209469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.340662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:31.348457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-37d48c1d-afda-416e-b5d6-23cff4d7ce52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153024 Sep 19 11:31:31.349024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 468/931] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:31.476057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:31.478102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:31.484027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.484506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.484947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.485628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:31.486081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:31.486505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:31.516723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6de1b607-1364-4e7b-9579-a3b291a97345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044709 Sep 19 11:31:31.517280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 464/932] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:32.068680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:32.070813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:32.077435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.077916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.078353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.079072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.079560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.079984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.110398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-94e86833-e72d-4266-ba49-6d1b99c0e89f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046335 Sep 19 11:31:32.110970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 469/933] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:32.192655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:32.194828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:32.201503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.201986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.202423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.203111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.203596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.204076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.233474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fd1fad12-b143-457c-9533-244d8ec595dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045412 Sep 19 11:31:32.234034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 465/934] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:32.371943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:32.372472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:32.379094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.379612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.380053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.380746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.381208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.381640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.510817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:32.518593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9cbf7237-8005-4d7d-b835-596cf03d6519 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150635 Sep 19 11:31:32.519161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 470/935] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:32.529163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:32.531368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:32.537942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.538426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.538868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.539591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:32.540059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:32.540486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:32.570114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70de86a2-2de4-4304-b1c5-0aa74107a1aa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Sep 19 11:31:32.570664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 466/936] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:33.123747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:33.125883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:33.132981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.133455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.133878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.134556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.134999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.135448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.163908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-82591d20-3719-4868-b527-fce9f8321feb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Sep 19 11:31:33.164465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 471/937] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:33.246563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:33.248654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:33.255084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.255605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.256044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.256741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.258268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.258268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.436209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-24036139-74ab-457e-b53f-57b3f00fcf3d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193644 Sep 19 11:31:33.436774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 467/938] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:33.541745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:33.542841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:33.548475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.548963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.549987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.550817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.551155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.551609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.582754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:33.584924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:33.590909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.591979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.592098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.592791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:33.593247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:33.593676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:33.598432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:33.624736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3c38f74d-dda6-46b5-bfdc-fc3f1173e04a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046614 Sep 19 11:31:33.629554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 468/939] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:33.688354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:33.696516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f5c89eb1-4d0b-4550-bc4a-0c14a12e9bf6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158603 Sep 19 11:31:33.697201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 472/940] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:34.177480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:34.179687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:34.186071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.186553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.187032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.187760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.188213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.188638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.219982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7292c3b2-7085-42b7-baf4-17eb1e1a9280 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047147 Sep 19 11:31:34.220542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 469/941] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:34.448915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:34.450972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:34.457807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.458291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.458730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.459469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.459928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.460354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.490579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d8d4b59b-cd78-46d1-86bc-67c0f6fc9efe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045665 Sep 19 11:31:34.491544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 473/942] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:34.637197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:34.639344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:34.641459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:34.646199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.656446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.656446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.656446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.656446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.656845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.678919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6f9579e8-56db-4c62-9e5c-ed701423ad45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045634 Sep 19 11:31:34.679565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 470/943] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:34.720357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:34.720894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:34.727390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.727878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.728313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.729003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:34.729462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:34.729886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:34.870201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:34.878024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23b709d0-3219-4e55-ba1b-481a0199f1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.161599 Sep 19 11:31:34.878605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 474/944] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:35.232380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:35.234544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:35.240529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.241012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.241451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:35.242140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.242595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.243022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:35.272162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-15f51670-d82c-4747-997e-b41391a1e33c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043791 Sep 19 11:31:35.272721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 471/945] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:35.503536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:35.505796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:35.508189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:35.512817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.513304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.513734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:35.514414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.514865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.515310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:35.544857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-82f20d26-2510-4ff4-80b9-87364166c6c6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Sep 19 11:31:35.545420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 475/946] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:35.691557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:35.693714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:35.700123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.700606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.701042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:35.701729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.702185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.702612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:35.732448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5e11b77b-c8b9-4cb7-94ce-be2d7fac1591 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045374 Sep 19 11:31:35.732999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 472/947] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:35.902231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:35.902762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:35.909126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.909605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.910042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:35.910736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:35.911219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:35.911651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:36.045603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:36.053960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7a256168-7341-4a3e-9f0a-18a5b9e423cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155924 Sep 19 11:31:36.054532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 476/948] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:36.285382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:36.287542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:36.293418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:36.293894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:36.294326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:36.295048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:36.295478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:36.295898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:36.325887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2bddfbaa-c77a-4620-a83d-6870321d479c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Sep 19 11:31:36.326438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 473/949] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:36.556789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:36.558880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:36.565467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:36.565845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:36.566283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:36.566981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:36.567476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:36.567899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:36.598185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-276b1afa-7288-400f-a0fc-456645f5972e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Sep 19 11:31:36.598749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 477/950] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:36.745532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:36.749198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:36.758082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:36.758558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:36.758986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:36.759742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:36.760188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:36.760607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:36.791156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9a58bdc-a99e-4b24-b63c-6541ed6d47c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049991 Sep 19 11:31:36.791719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 474/951] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:37.077912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:37.078521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:37.084739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.085226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.085669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.086358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.086821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.087281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.216140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:37.219576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:37.224643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6e9a7b08-3c08-417e-bc61-35722798853a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150628 Sep 19 11:31:37.225220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 478/952] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:37.338927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:37.341097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:37.347774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.348256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.348690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.349370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.349821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.350242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.378916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bebc23b1-0a09-42df-83b7-cb9cae2d0d91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044064 Sep 19 11:31:37.379537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 475/953] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:37.611327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:37.613467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:37.620066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.620543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.629781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.629781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.629781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.629781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.651471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5345fe24-e798-4cc9-960b-8a943ad66d6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044664 Sep 19 11:31:37.652043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 479/954] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:37.804273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:37.807247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:37.813654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.814145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.814586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.815869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:37.816323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:37.816753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:37.848382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-13de23e5-4a8f-4442-b17c-aa26e94316da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048123 Sep 19 11:31:37.848948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 476/955] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:38.248599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:38.249247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:38.255491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.255987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.256426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.257168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.257624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.258054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.391806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:38.394136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:38.394515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:38.400686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.401317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.401752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.402359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fc9e5ab3-0fb7-4696-9631-44483b4fd24b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157612 Sep 19 11:31:38.402511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.402894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.403049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 480/956] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:38.403349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.433394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cebd2500-6f81-425e-bcf5-ddc76825f4e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045803 Sep 19 11:31:38.433946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 477/957] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:38.664357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:38.666475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:38.672859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.673345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.673785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.674475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.674928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.675387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.704294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-955e7d01-d199-46ed-a53f-6560a93bbb30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Sep 19 11:31:38.704850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 481/958] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:38.861359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:38.864094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:38.882073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.882570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.883013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.883748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:38.884209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:38.884636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:38.913974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d9118082-e189-4909-b2b4-07cda2f5afc1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056531 Sep 19 11:31:38.914598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 478/959] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:39.426873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:39.427516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:39.433503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.433985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.434422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.435111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.435597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.436024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.446254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:39.449098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:39.455676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.456155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.456592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.457284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.457727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.458143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.491698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-05ff6737-4f8b-4eef-b2df-b4621398de59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049336 Sep 19 11:31:39.495228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 479/960] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:39.577218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:39.585866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-382e786b-76ca-4e52-831c-3c71bf62451e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.163691 Sep 19 11:31:39.586439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 482/961] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:39.717909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:39.720001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:39.726430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.726903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.727375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.728049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.728493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.728909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.756876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8e831de5-f5c4-4a29-8c8c-bfb0fd2a18fe tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042960 Sep 19 11:31:39.757419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 480/962] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:39.926340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:39.928577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:39.934536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.935020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.935489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.936183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:39.936639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:39.937064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:39.966994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d6c30a82-933b-424a-aeba-154e68b8576a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044627 Sep 19 11:31:39.967581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 483/963] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:40.505496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:40.507693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:40.514116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.514598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.515035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:40.515749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.516207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.516635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:40.546666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aa262a6b-7b52-4126-a799-054c1deacf9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Sep 19 11:31:40.547224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 481/964] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:40.609709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:40.610327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:40.616831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.617308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.617739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:40.618423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.618870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.619347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:40.750149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:40.758726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30c2ae9b-9419-4397-9360-0d35f9f37c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152920 Sep 19 11:31:40.759261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 484/965] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:40.770093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:40.772397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:40.778378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.778868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.779336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:40.780024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.780533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.780902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:40.809896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ddec221b-b730-48e7-b3e9-4171baaa7e33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Sep 19 11:31:40.810460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 482/966] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:40.979546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:40.981681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:40.987581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.988120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.988645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:40.989344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:40.989797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:40.990220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:41.020417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff78d537-d5db-4084-bfa0-c8ba85b0ea4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044240 Sep 19 11:31:41.020910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 485/967] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:41.558770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:41.561154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:41.567866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:41.568357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:41.568791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:41.569498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:41.569960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:41.570385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:41.602202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cc003e94-b0f8-4132-9f66-7040cbf1a2dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047371 Sep 19 11:31:41.602768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 483/968] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:41.781971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:41.782574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:41.789543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:41.790028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:41.790467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:41.791151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:41.791627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:41.792049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:41.823019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:41.825172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:41.831390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:41.831877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:41.832310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:41.833005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:41.833465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:41.833892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:41.859098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:41.864780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e0e84189-2291-4617-a0cb-23171d750142 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045669 Sep 19 11:31:41.865240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 484/969] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:41.929985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:41.938330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c33fb9ae-297a-4374-9025-53a84ec5cdda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160232 Sep 19 11:31:41.938906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 486/970] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:42.032562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:42.034730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:42.041512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.043613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.043613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:42.043613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.043613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.044050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:42.074807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d1a932a7-5a1d-49ac-b1fe-bcc0c24f5f86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046457 Sep 19 11:31:42.075312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 485/971] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:42.614715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:42.616929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:42.623019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.623537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.623976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:42.624696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.625154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.625584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:42.655419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-72a974fb-4b7b-421a-aad2-d8a0bd0550b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044585 Sep 19 11:31:42.655978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 487/972] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:42.876674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:42.879896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:42.887927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.888410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.888957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:42.889657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.890104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.890521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:42.922664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e45f8adb-a8df-45ea-aad0-3f0b3481463f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050165 Sep 19 11:31:42.923236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 486/973] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:42.961684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:42.962869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:42.969303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.969795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.970236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:42.970959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:42.971454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:42.971881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:43.087366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:43.089555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:43.096964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:43.097861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:43.098650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:43.099747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:43.100208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:43.100639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:43.102035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:43.109936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e1e743e8-bc89-43a8-9bcc-882baf7356e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152019 Sep 19 11:31:43.110719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 488/974] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:43.132208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-72d6a640-d72b-4d15-b64a-c1141d223622 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048705 Sep 19 11:31:43.132706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 487/975] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:43.668290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:43.670469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:43.677238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:43.681872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:43.681872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:43.681872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:43.681872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:43.682268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:43.709340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-22a9b0c2-d3da-4870-933a-e9ec0073ca67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045101 Sep 19 11:31:43.709933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 489/976] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:43.935311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:43.937463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:43.944271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:43.944760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:43.945195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:43.945892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:43.946345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:43.946795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:43.978912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-18f0fc0d-6d0f-4994-8d9e-04a29ccc6724 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047639 Sep 19 11:31:43.979504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 488/977] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:44.133942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:44.134558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:44.141508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:44.141916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:44.142358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:44.143066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:44.143570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:44.143725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:44.144002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:44.145883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:44.152364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:44.152852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:44.153287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:44.153984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:44.154441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:44.154867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:44.184469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a6fc0ace-d410-4b5a-9754-9b2da95639f8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044550 Sep 19 11:31:44.185148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 489/978] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:44.500674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:44.509279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-00431914-c82a-4e5f-8fa1-b20395ceb482 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.380024 Sep 19 11:31:44.509849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 490/979] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:44.721298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:44.723599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:44.729460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:44.729944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:44.730380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:44.731069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:44.731550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:44.731978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:44.768650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d9429c48-3e25-4919-aa9e-cbe0b9306334 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051177 Sep 19 11:31:44.769161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 490/980] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:44.992228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:44.994350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:45.000307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.000786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.001217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.001900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.002344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.002884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.031016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9bb4d4cf-b5a4-4b84-a61c-2d97c722b848 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Sep 19 11:31:45.031521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 491/981] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:45.197128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:45.199304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:45.205989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.211413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.211413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.211413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.211413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.211773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.238477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6b93bcbe-ddb6-4603-a767-e0a33e6481c4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Sep 19 11:31:45.239061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 491/982] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:45.533260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:45.533858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:45.540875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.541356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.541783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.542466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.542914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.543371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.672916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:45.680856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bd40875f-9a40-4e8e-a98f-7a762aa62167 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151566 Sep 19 11:31:45.681427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 492/983] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:45.781288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:45.783530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:45.789479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.789963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.790402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.791085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:45.791568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:45.792047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:45.821201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-de5da384-b993-4512-8594-611e50f5231a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043940 Sep 19 11:31:45.821846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 492/984] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:46.043618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:46.045674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:46.051650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.052140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.053059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.053761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.054210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.054639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.083635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bed8d75f-c6f5-453b-be12-f14d9447de5b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044079 Sep 19 11:31:46.084192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 493/985] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:46.251248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:46.253456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:46.260500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.260975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.261404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.262082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.262531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.262953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.291639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e4d739df-0f2e-439c-a1f9-3221d9f70685 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044334 Sep 19 11:31:46.292190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 493/986] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:46.703454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:46.704067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:46.711798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.712279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.712717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.713410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.713871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.714295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.835120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:46.837442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:46.843427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.843991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.844493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.845253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:46.845797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:46.846291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:46.850130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:46.858281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-77938ac1-826b-4319-a338-08b7aec95814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158693 Sep 19 11:31:46.858860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 494/987] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:46.878071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a77e8739-047e-463a-a415-d8cd2a10bef1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047760 Sep 19 11:31:46.878625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 494/988] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:47.096443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:47.098579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:47.104647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.105130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.105568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.106296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.106755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.107208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.124298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:47.137256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a523bb79-edef-4722-9f6d-46cf5d367415 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044899 Sep 19 11:31:47.139493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 495/989] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:47.303463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:47.305643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:47.312136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.312562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.313004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.313691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.314149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.314579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.344440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e1424aaa-a744-4a16-a7ae-87f67431fb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044927 Sep 19 11:31:47.344992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 495/990] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:47.882488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:47.883136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:47.889897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:47.890197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.890433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.890883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.891621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.892081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.892222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:47.892510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.898292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.898786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.899251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.899959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:47.900417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:47.900843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:47.932169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-13f140a9-6825-40d0-ae27-2673b8c57072 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046144 Sep 19 11:31:47.932744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 496/991] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:31:48.027511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:48.035325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8ab8084f-6454-4f74-9fa2-0e328d9fe2b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157218 Sep 19 11:31:48.035893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 496/992] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:48.150805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:48.153089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:48.159145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.159662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.160098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.160794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.161253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.161695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.192938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fcd161c6-8c2d-4644-af45-2d486498d3e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Sep 19 11:31:48.193589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 497/993] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:48.357081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:48.359250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:48.365178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.365664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.366096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.366807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.367329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.367717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.397030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f480460d-5226-4b98-bb50-0ebede3a7211 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043363 Sep 19 11:31:48.397599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 497/994] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:48.945451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:48.948365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:48.955810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.956298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.956733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.957444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:48.957901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:48.958327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:48.988371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f2fb6211-2e10-40bb-ae32-1c575108a6a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046921 Sep 19 11:31:48.988943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 498/995] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:49.059429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:49.060072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:49.066584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.067098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.067579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.068960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.069425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.069855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.200276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:49.208131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:49.208342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:49.208460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a0c5ab2-96f1-47b1-aefb-452ccc6332c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152781 Sep 19 11:31:49.208938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 498/996] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:49.214328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.214860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.215336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.216034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.216491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.216917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.246410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d12be8c6-3da6-4f58-b4b7-3f6932e8f550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Sep 19 11:31:49.246973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 499/997] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:49.409599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:49.412299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:49.418492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.418989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.419458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.420162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:49.420630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:49.421061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:49.450523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d68b4839-4c23-457e-b93e-c084e76f5d34 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044825 Sep 19 11:31:49.451007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 499/998] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:50.002289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:50.004479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:50.010832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.011343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.011772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.012452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.012899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.013318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.043325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e8f7578c-a7bc-4b93-ac4a-bba50eb6076f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045561 Sep 19 11:31:50.043879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 500/999] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:50.231685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:50.232325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:50.238763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.239275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.239716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.240437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.240894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.241319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.258691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:50.260804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:50.266665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.267142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.267871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.268299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.268752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.269176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.288632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:50.301694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3ddd27bb-8ee3-4b75-b234-155c6b135b3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047485 Sep 19 11:31:50.302267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 501/1000] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:50.376125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:50.384508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-483fc9a8-b3e6-43b4-aa43-5862192c19c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156719 Sep 19 11:31:50.385083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 500/1001] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:50.463293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:50.465638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:50.472592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.473073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.473511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.474204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:50.474661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:50.475092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:50.504312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b0f80286-3bd0-4bdf-bc6b-3a5a917e8c4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044997 Sep 19 11:31:50.504864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 502/1002] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:51.056147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:51.058269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:51.064351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.064833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.065280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.065949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.066405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.066825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.099953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-353c5c97-16f2-4670-9702-4db7e03b1a79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047710 Sep 19 11:31:51.100529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 501/1003] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:51.314687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:51.316791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:51.324137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.324624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.325063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.325767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.326219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.326646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.356412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0bbbc95e-4e65-4361-b863-cf522fe50b85 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045744 Sep 19 11:31:51.356985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 503/1004] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:51.407939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:51.418404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:51.418404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.418404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.418404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.418858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.418858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.418858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.517810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:51.520128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:51.526120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.526615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.527052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.527786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:51.528246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:51.528702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:51.554321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:51.561030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-896b7f67-d83a-4352-8a9d-6a5340bf4a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047117 Sep 19 11:31:51.561641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 504/1005] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:51.562431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-307d3b39-d18b-4a94-af0a-e6c713f7c9e3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158543 Sep 19 11:31:51.563005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 502/1006] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:52.116187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:52.118933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:52.124805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.125294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.125740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.126440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.126902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.127389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.157271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8b20b888-c5c5-4f55-9382-45b44e1d4879 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048196 Sep 19 11:31:52.157855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 505/1007] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:52.370890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:52.373008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:52.379049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.379546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.379980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.381194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.381650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.382071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.411533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7577610-94cb-4593-8408-fa369a49a372 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Sep 19 11:31:52.412100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 503/1008] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:52.574532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:52.576727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:52.583552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.584699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.585144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.585844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.586300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.586597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:52.586720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.587231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:52.593602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.594085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.594522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.595236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:52.595694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:52.596120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:52.616156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb1eec94-ddc4-4a5a-ad92-a4c5ce86be5e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045558 Sep 19 11:31:52.616739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 506/1009] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:52.729221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:52.737008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-36944f74-c69d-4cd1-93ba-17320f210ab2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154740 Sep 19 11:31:52.737582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 504/1010] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:53.170712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:53.172911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:53.179471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.179951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.180392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.181079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.181526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.181944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.211642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0df067fe-2f56-4232-9220-bb4a91842bae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044853 Sep 19 11:31:53.212206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 507/1011] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:53.423975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:53.426069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:53.432094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.432579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.433020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.433710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.434169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.434595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.463677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-32d42c85-fb00-44cf-a375-130c572e75db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043769 Sep 19 11:31:53.464238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 505/1012] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:53.628619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:53.630753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:53.637751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.638238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.638672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.639405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.639855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.640273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.670543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9f9f6e81-d680-4525-829f-49899cfbd6cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045891 Sep 19 11:31:53.671094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 508/1013] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:53.760866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:53.761483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:53.767939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.768424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.768864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.769551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:53.770009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:53.770434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:53.900046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:53.907852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-36f4c574-ceb1-440e-9b43-d9ec9974f824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150935 Sep 19 11:31:53.908423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 506/1014] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:54.224035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:54.226186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:54.232149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.232633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.233071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.233753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.234213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.234633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.264856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3167b873-b65f-4102-a9b2-e847e3a464cc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044772 Sep 19 11:31:54.265402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 509/1015] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:54.476454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:54.478574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:54.484733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.485218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.485654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.486342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.486798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.487253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.517748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-57164b57-2943-42a4-b818-e45ef58bd1f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Sep 19 11:31:54.518316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 507/1016] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:54.683677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:54.685884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:54.692620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.693110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.693560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.694269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.694728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.695155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.725564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-040cd915-e6f1-459f-b608-b416680d9669 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045947 Sep 19 11:31:54.726122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 510/1017] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:54.932421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:54.933028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:54.939481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.939966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.940410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:54.941101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:54.941557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:54.941983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.083052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:55.090787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-18068b75-0dc5-43ed-ba63-abe8743938ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.162283 Sep 19 11:31:55.091380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 508/1018] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:55.277752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:55.279941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:55.285969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.286454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.287439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.288131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.288589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.289024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.318570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6db267a7-8048-4f69-b5f8-2e0d76ee5b45 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044844 Sep 19 11:31:55.319134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 511/1019] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:55.530617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:55.532761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:55.539464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.539954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.540471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.541165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.541622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.542052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.573465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b63d4e34-f7ac-4994-95df-5a4481a32d72 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046906 Sep 19 11:31:55.574032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 509/1020] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:55.738037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:55.740355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:55.746762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.747284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.747725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.748560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:55.749013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:55.749442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:55.779122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4824331c-d8e9-4092-a994-0635c2f142e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045036 Sep 19 11:31:55.779704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 512/1021] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:56.114164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:56.114784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:56.121315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.121799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.122239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.122998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.123469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.123875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.256120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:56.263811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e828271-7659-4969-b790-a83554d97f4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153744 Sep 19 11:31:56.264388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 510/1022] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:56.331572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:56.334390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:56.340397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.340882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.342139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.342854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.343349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.343789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.375153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dea293e1-b644-416f-80e0-7b6f2c8cae74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047744 Sep 19 11:31:56.375692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 513/1023] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:56.586626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:56.588862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:56.594714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.597508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.597508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.597508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.597508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.597893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.626522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-24116406-6447-470c-8cbd-f833297c837e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Sep 19 11:31:56.627001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 511/1024] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:56.792605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:56.794784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:56.801272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.801760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.802846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.803615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:56.804271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:56.804717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:56.834517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85d8596d-efaa-484c-b107-1b7e306ac52a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046229 Sep 19 11:31:56.835142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 514/1025] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:57.287334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:57.288515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:57.294916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.295430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.295862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.296551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.297003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.297423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.301374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:57.388451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:57.390711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:57.397511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.398093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.398533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.399340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.399801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.400225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.430967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fbabf77f-eedc-4f1a-8c9b-0f32ac5862d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046722 Sep 19 11:31:57.431633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 515/1026] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:57.438011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:57.445682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9b1f2e82-4639-4ee3-96da-d4db530563ea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.162247 Sep 19 11:31:57.446239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 512/1027] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:57.639624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:57.641710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:57.648379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.648854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.649367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.650045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.650488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.650909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.679328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0ee01325-4f9e-4943-b380-2d6a7d3d5a09 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043823 Sep 19 11:31:57.679891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 516/1028] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:57.846061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:57.848264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:57.854804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.855322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.855759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.856533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:57.856908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:57.857335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:57.887108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ad6353e2-75b8-4acd-9c8b-c35685f541a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045037 Sep 19 11:31:57.887987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 513/1029] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:58.444541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:58.446602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:58.453106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.453585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.454020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.454998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.455490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.455914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.468688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:58.469296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:58.475772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.476266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.476706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.477405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.477863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.478291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.487058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-56da1838-0b7f-4ed2-a782-e4174704d74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047122 Sep 19 11:31:58.487666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 517/1030] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:58.612788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:58.621058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-349013d8-febe-4acf-8cc3-769d9aa5d99d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156247 Sep 19 11:31:58.621631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 514/1031] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:31:58.692150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:58.694995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:58.700915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.701399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.701841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.702533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.702993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.703450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.707281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:58.732259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d881a263-bb4c-4095-b6da-fd86851e976f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044031 Sep 19 11:31:58.732815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 518/1032] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:58.899910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:58.902054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:58.908007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.908489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.908924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.909610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:58.910067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:58.910489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:58.940043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cfc2090d-f2b9-49ed-9d5d-5674bc7a9904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044094 Sep 19 11:31:58.940598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 515/1033] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:31:59.499311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:59.501489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.508691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.509177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.509610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.510301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.510757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.511196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.541404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5a636e59-04de-469d-a0a1-adecb58be953 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046108 Sep 19 11:31:59.541952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 519/1034] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:31:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:31:59.644785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:59.645315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.652159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.652637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.653075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.653758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.654216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.654638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.744653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:59.746824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.748683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:31:59.753363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.753853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.754294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.754995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.755491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.755917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.786642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-02c27a53-f1b8-49e9-9324-a9dad2386ce8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045799 Sep 19 11:31:59.787497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 520/1035] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:31:59.792003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:31:59.800977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f96aa046-9030-4a51-801d-e06d17b4102b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160038 Sep 19 11:31:59.801557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 516/1036] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:31:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:31:59.953155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:31:59.955662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:31:59.962515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.963007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.963478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.964176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:31:59.964635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:31:59.965064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:31:59.995084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-52c62f27-877c-4972-9a0a-76c749392411 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045814 Sep 19 11:31:59.995683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 521/1037] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:31:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:00.554078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:00.556263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:00.562439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.562924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.563397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.564117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.564575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.565003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.595748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-11cb6012-6186-4605-b740-429c8b906faf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046310 Sep 19 11:32:00.596299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 517/1038] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:00.799019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:00.801178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:00.808240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.808662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.809090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.809774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.810221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.810641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.823841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:00.824449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:00.831294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.833461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.833461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.833461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:00.833461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:00.833838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:00.841414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb4e559a-f542-482a-a16f-186bcad50fcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046357 Sep 19 11:32:00.841974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 522/1039] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:00.971923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:00.980499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54539b9a-55dc-4fab-94ba-15f8eda1296a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160515 Sep 19 11:32:00.981740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 518/1040] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:01.006930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:01.012908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:01.021673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.021673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.021673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.022877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.023381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.023979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.056496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1d91b86c-e051-4c7b-b4ad-b5de1b57f28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053580 Sep 19 11:32:01.057075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 523/1041] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:01.609318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:01.611493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:01.618496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.618857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.619332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.620058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.620511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.620924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.651600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7c432e70-14b7-4430-9c01-76a3f489e567 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046369 Sep 19 11:32:01.652158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 519/1042] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:01.853224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:01.855575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:01.862163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.862584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.863055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.863775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:01.864233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:01.864659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:01.894667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0175edb9-a88f-4b3b-8a89-5d8dadff877d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045443 Sep 19 11:32:01.895247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 524/1043] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:02.004008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:02.004679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:02.012355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.012853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.013301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.014022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.014486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.014917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.069630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:02.071959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:02.078573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.079139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.079628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.080594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.081041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.081466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.113545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0293663f-5d85-4043-bf0a-bc9c686564ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047887 Sep 19 11:32:02.114583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 525/1044] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:02.152191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:02.159916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-71e0ec7c-f68c-4389-a6ae-0e07d7991096 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159892 Sep 19 11:32:02.160489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 520/1045] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:02.664959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:02.667139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:02.673255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.673737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.674178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.674879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.675352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.675783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.705328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b1b22105-3a21-4339-8e94-21a355d11bb8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044762 Sep 19 11:32:02.705888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 526/1046] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:02.907318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:02.909490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:02.915744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.916169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.916608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.917303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:02.917757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:02.918183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:02.946799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-84a52f2c-9c7b-47fe-95ad-34986015e084 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Sep 19 11:32:02.947387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 521/1047] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:03.126038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:03.128370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:03.135934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.136423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.136979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.137681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.138139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.138566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.167746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c2da9b27-104d-4071-8ae4-2fd24502759a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Sep 19 11:32:03.168235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 527/1048] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:03.183618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:03.184227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:03.190573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.191050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.191587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.192317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.192762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.193183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.325918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:03.333923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cebfe287-cff1-4415-bd8a-c7a04ee17b20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154338 Sep 19 11:32:03.337753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 522/1049] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:03.820116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:03.822380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:03.828362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.828851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.829349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.830305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.830759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.831207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.860428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-02ef07b4-82f8-49e2-b33e-38b57ef8b449 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.146228 Sep 19 11:32:03.860996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 528/1050] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:03.960359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:03.962485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:03.968449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.968928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.969355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.970101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:03.970489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:03.970908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:03.999720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-94cc1735-f352-4fe8-8b6c-775a518bf6e7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044075 Sep 19 11:32:04.000268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 523/1051] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:04.186092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:04.188348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:04.194891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.195405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.195841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.196536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.196983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.197413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.228592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-067f6d35-fe09-40c0-a819-1e6836c019ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046341 Sep 19 11:32:04.229060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 529/1052] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:04.357151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:04.357768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:04.364278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.364764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.365203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.365935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.366394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.366821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.496521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:04.504188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fb14e7e5-b1b3-430e-aaca-3635c90c06ee tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150939 Sep 19 11:32:04.504771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 524/1053] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:04.873069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:04.875282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:04.881236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.882281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.882722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.883445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:04.883907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:04.884330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:04.913305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-351eef48-1c41-4ff8-b484-9d357a5b4961 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044181 Sep 19 11:32:04.913858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 530/1054] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:05.012652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:05.014829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:05.016713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:05.021367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.022463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.022914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.023645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.024101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.024526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.056479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c3e2b9e2-cd0f-45df-8dd0-3b8bf15eab1d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047731 Sep 19 11:32:05.057050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 525/1055] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:05.241282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:05.243418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:05.249987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.250465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.250905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.251655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.252111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.252534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.282527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-11584e4e-1425-4ea0-92aa-ea8606c81a9d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045274 Sep 19 11:32:05.283069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 531/1056] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:05.527745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:05.528355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:05.535187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.535680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.536114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.536798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.537253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.537681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.667530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:05.675487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f2923ebd-d395-46d3-bc79-8512a4a95490 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151632 Sep 19 11:32:05.676063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 526/1057] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:05.925569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:05.927689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:05.934179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.934655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.935082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.935790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:05.936237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:05.936658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:05.966552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-570f7d6c-9a5e-42c0-9971-a025ed279844 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044966 Sep 19 11:32:05.967111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 532/1058] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:06.069051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:06.071286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:06.078689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.079202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.079894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:06.080585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.081033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.081450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:06.110648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fe015cf0-64d5-44a1-bc9b-e1704b6f8bc4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045498 Sep 19 11:32:06.111456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 527/1059] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:06.294601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:06.296781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:06.303248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.303733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.304174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:06.304868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.305325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.305755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:06.335055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f5299ac2-5be2-4f7f-a1b2-c46cdf6d558c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Sep 19 11:32:06.336139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 533/1060] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:06.699768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:06.700346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:06.707070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.707590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.710391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:06.710391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.710391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.710391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:06.787991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:32:06.788213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:32:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:32:06.850879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:06.854257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:06.858796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-914bbda9-8284-4851-8c86-f090b5801c6b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.163502 Sep 19 11:32:06.859395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 528/1061] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:06.979784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:06.981851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:06.987949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.988433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.988872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:06.989567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:06.990022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:06.990451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:07.016247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:07.020918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9f7c7a02-0f94-4d2c-b05e-2dd1bd2adcbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045416 Sep 19 11:32:07.021482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 534/1062] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:07.233002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:07.235739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:07.242483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:07.242977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:07.243626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:07.244330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:07.244791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:07.245216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:07.274877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c84337db-3752-4b60-8c8d-9a5192af22cc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.155048 Sep 19 11:32:07.275471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 529/1063] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:07.348375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:07.350504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:07.357565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:07.358044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:07.358478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:07.359164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:07.359642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:07.360059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:07.390195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-da7d30f8-78a1-455a-b9c3-787c386218ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046053 Sep 19 11:32:07.390758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 535/1064] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:07.882497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:07.883042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:07.889490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:07.889974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:07.890410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:07.891104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:07.891585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:07.892010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.023766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:08.032000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa027e62-1fa9-4b07-84a6-0b52c8e86d4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153394 Sep 19 11:32:08.032573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 530/1065] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:08.033243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:08.035601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:08.041731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.042218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.042700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.043390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.043855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.044273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.074031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9c527d95-c570-45bd-ac21-7ec4dc80e8b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044739 Sep 19 11:32:08.074596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 536/1066] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:08.287817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:08.290032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:08.296003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.296489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.296929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.297619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.298075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.298506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.327426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23261ace-b969-4ac9-bd2e-24375fd687ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043511 Sep 19 11:32:08.327979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 531/1067] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:08.402944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:08.405145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:08.411761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.412251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.412687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.413382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:08.413841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:08.414271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:08.444324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-51b1dd05-3830-4c50-8aaf-7542f102e3c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045661 Sep 19 11:32:08.444876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 537/1068] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:09.054068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:09.055318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:09.061414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.061910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.062330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.063013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.063491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.063916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.086970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:09.089162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:09.096417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.096904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.097334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.098031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.098483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.098912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.130419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-317cc4f2-8f37-4fcc-abce-d7cb965a4bbd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047932 Sep 19 11:32:09.131096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 538/1069] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:09.209804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:09.217717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a3f817e2-a820-472a-9775-6094486a45e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.167718 Sep 19 11:32:09.218279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 532/1070] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:09.340377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:09.342450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:09.348684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.349172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.349614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.350306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.350756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.351195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.380909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b834c749-9c33-4ca3-b23d-4e5925ed07ee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Sep 19 11:32:09.381464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 539/1071] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:09.457512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:09.459662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:09.465586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.466067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.466498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.467189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:09.467651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:09.468074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:09.499469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6a7ac33c-80f1-401e-a6b3-710d82357c64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046182 Sep 19 11:32:09.500022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 533/1072] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:10.143404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:10.145561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:10.152504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.152990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.153427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.154121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.154578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.155008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.189904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cac23610-5d05-4a7e-81e3-da060d3fabab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050504 Sep 19 11:32:10.190479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 540/1073] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:10.240493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:10.241099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:10.247544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.248037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.248473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.249159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.249620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.250046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.380846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:10.389117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3c08bd34-5e85-41ef-808b-e3c9c9f9787f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152525 Sep 19 11:32:10.389689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 534/1074] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:10.394766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:10.396986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:10.403626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.404116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.404550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.405242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.405698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.406120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.434963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cdfbbb5d-9fc9-42c9-aff7-133dc27d654f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Sep 19 11:32:10.435544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 541/1075] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:10.512614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:10.514757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:10.520792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.521280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.521721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.522463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:10.522957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:10.524046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:10.553112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-33b9fc7f-3584-42b3-be90-8510fc4ec5e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044484 Sep 19 11:32:10.553672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 535/1076] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:11.209968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:11.212165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:11.218455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.221768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.221768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.221768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.221768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.222222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.251552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7eb2d3dc-1c10-4ae8-b2ac-690aca1fabae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045603 Sep 19 11:32:11.252096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 542/1077] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:11.414486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:11.415103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:11.421302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.421794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.422292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.423011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.423484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.423911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.447135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:11.449334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:11.455601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.456091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.456532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.457234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.457688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.458112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.490243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8d9f6ad2-c5ce-43c6-ac1a-2da5e6707462 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047140 Sep 19 11:32:11.490818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 543/1078] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:11.560138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:11.565900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:11.568083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:11.568347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ec46efd3-f055-40d6-b9bb-a84aaf71581b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158969 Sep 19 11:32:11.568972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 536/1079] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:11.574172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.574656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.575091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.575874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:11.576331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:11.576763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:11.607461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-337cc074-c94a-40e7-b583-160fe26fed44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045382 Sep 19 11:32:11.607938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 544/1080] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:12.265912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:12.268375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:12.274447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.274925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.275393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.276116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.276564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.276980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.307136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e996db2d-8485-496b-acf8-c4855ec622fd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046043 Sep 19 11:32:12.307742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 537/1081] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:12.503020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:12.505216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:12.515465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.515465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.515465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.515465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.515909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.515909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.553382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-463075fd-c88f-4b77-b6fa-5d0f181b95af tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054261 Sep 19 11:32:12.553960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 545/1082] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:12.592376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:12.593238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:12.599754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.600240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.600669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.601849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.602300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.602721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.620058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:12.622317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:12.628207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.628695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.629146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.629842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:12.630298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:12.630726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:12.660498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3af0587b-79bb-4a56-b7e1-9ce85336a538 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044944 Sep 19 11:32:12.661070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 546/1083] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:12.732669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:12.740359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87f765f1-2a99-430f-9b8c-4bc32b30a549 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152327 Sep 19 11:32:12.740918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 538/1084] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:13.320437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:13.322500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:13.328666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.329149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.329843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.330538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.330993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.331674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.361493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1bc17f16-2cb9-4cf3-a880-bd07eb539a8c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045648 Sep 19 11:32:13.362039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 547/1085] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:13.566597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:13.568842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:13.575610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.576037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.576478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.577172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.577632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.578059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.609106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9c1cc6e5-ba40-4ec2-9828-c5165bc48f6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046576 Sep 19 11:32:13.609778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 539/1086] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:13.673034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:13.675256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:13.681600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.682081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.682528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.683261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.683799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.684245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.714798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e605c950-33a7-415e-9227-f273b38de64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045839 Sep 19 11:32:13.715385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 548/1087] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:13.764649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:13.765263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:13.771229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.771712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.772147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.772832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:13.773283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:13.774222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:13.903474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:13.911143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-36e311b4-d24d-4686-b9ea-c3bf065d789c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150441 Sep 19 11:32:13.911726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 540/1088] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:14.374266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:14.376413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:14.382338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.382827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.383932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.384630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.385086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.385513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.414803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2fc93da4-9e93-4271-8204-62503c74075e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044585 Sep 19 11:32:14.415384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 549/1089] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:14.622091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:14.624253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:14.630753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.631187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.631624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.632305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.632749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.633167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.662468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-71f38c8c-2df7-44bd-8ba0-d09246eefa05 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044768 Sep 19 11:32:14.663014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 541/1090] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:14.727187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:14.729838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:14.736165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.736646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.737082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.737769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.738220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.738641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.767868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ab3673c4-70b6-4111-944a-263014cd9081 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044577 Sep 19 11:32:14.768420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 550/1091] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:14.934606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:14.935298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:14.941441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.941928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.942371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:14.943064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:14.943555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:14.943985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.077820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:15.085769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dad8ec9a-0d0b-4ea7-9c8c-160f0343ce5f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155794 Sep 19 11:32:15.086328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 542/1092] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:15.427605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:15.429784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:15.435935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.436426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.436863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.437564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.438015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.438447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.456057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:15.469616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8c60e1ea-4b0b-49e0-bf97-fd0fce630a00 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046255 Sep 19 11:32:15.470178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 551/1093] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:15.675533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:15.677698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:15.684055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.684538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.684973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.685652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.686096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.686517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.780891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:15.783099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:15.790142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.790635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.791067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.791823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:15.792274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:15.792702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:15.826006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a2acbda7-96ca-49c1-849b-38dcab2e72b5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049435 Sep 19 11:32:15.826595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 552/1094] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:15.866610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23d6b926-46f5-4a41-8a86-f8d454601ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.195021 Sep 19 11:32:15.867181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 543/1095] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:16.110400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:16.111012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:16.117481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.117599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.117983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.118681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.119140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.119595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.250085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:16.257811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-996db79e-3cb3-4d90-bd57-02d1375aee3a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151946 Sep 19 11:32:16.258377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 553/1096] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:16.482861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:16.484920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:16.491295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.491780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.492278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.492965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.493412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.493831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.524995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b3f2d05-36d4-46e7-8254-c1575cce7ec5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046350 Sep 19 11:32:16.525557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 544/1097] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:16.838433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:16.840746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:16.847265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.847781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.848221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.848915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.849367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.849793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.879702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:16.880693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-89c65ec3-805c-45bc-a803-882676c40adc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046088 Sep 19 11:32:16.881283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 554/1098] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:16.881823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:16.889194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.889671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.890107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.890792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:16.891261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:16.891679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:16.908185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:16.921225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7c0d6e45-a726-4e7e-952a-0449f420e19f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Sep 19 11:32:16.921784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 545/1099] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:17.281782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:17.282383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:17.288473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.288946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.289382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.290053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.290506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.291023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.423466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:17.431232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1d781219-75c8-47ae-94d5-c858c74d6b86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153811 Sep 19 11:32:17.431817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 555/1100] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:17.536818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:17.538963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:17.545955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.546438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.546878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.547601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.548060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.548489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.578171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-47ae813e-0ab3-4985-bb1d-4c0bbd239e69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045286 Sep 19 11:32:17.578732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 546/1101] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:17.894347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:17.896570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:17.903099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.903623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.904182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.905403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.905856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.906281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.933713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:17.936069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-679a68f5-5a2b-4dbe-a865-fea64b7f1875 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045576 Sep 19 11:32:17.936493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:17.936912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 556/1102] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:17.943085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.943708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.944140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.944832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:17.945281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:17.945701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:17.975060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-295e447f-32b5-4e8c-98e8-692018210ecf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Sep 19 11:32:17.975650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 547/1103] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:18.453995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:18.454853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:18.460939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.461421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.461851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.462536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.462983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.463421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.591716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:18.593711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:18.593901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:18.599949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.600432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.600862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.601549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.601673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ed8dc6ab-451d-4a97-8afa-1c2d7cf76df4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151468 Sep 19 11:32:18.601999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.602118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 557/1104] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:18.602488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.632245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c011b89e-7627-4a3e-81cb-efb16e685d9f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044605 Sep 19 11:32:18.632776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 548/1105] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:18.948653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:18.950837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:18.957480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.957964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.958401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.959088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.959575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.960004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.988565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:18.990169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6d9399e4-b7cb-472e-9451-573e4574ad41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045504 Sep 19 11:32:18.990700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:18.990828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 558/1106] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:18.997176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.997653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.998085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:18.998766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:18.999247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:18.999669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:19.028861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e2411775-5ee6-4c6d-857a-0aad0961565a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Sep 19 11:32:19.030192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 549/1107] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:19.625654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:19.626251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:19.632233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:19.632708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:19.633135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:19.633812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:19.634261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:19.634680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:19.645185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:19.647317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:19.653543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:19.654101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:19.654549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:19.655276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:19.655764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:19.656193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:19.687299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-79efcf5a-c0e0-4ecc-ad07-bb992dda24bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045881 Sep 19 11:32:19.687851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 550/1108] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:19.764773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:19.772488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b24ae7ed-4e9a-4f0e-8534-237c6881b49a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151197 Sep 19 11:32:19.773048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 559/1109] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:20.002620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:20.004758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:20.011137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.011645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.012078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.012761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.013215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.013640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.042137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:20.042700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0f5438f0-fb7d-45af-a525-a47960fdfba6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044317 Sep 19 11:32:20.042958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 551/1110] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:20.045193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:20.051717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.052202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.052641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.053339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.053797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.054224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.083584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-37ec8fa7-3a28-446c-9745-f4c305945492 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045454 Sep 19 11:32:20.084148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 560/1111] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:20.702069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:20.704472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:20.710505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.710991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.711477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.712169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.712625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.713052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.742150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-21e75afd-3026-44c3-873f-0e22c45c9b4f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044613 Sep 19 11:32:20.742697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 552/1112] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:20.795291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:20.795930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:20.801836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.802314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.802784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.803492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:20.803951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:20.804370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:20.943339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:20.946052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf493fd3-7507-4e59-ae8f-b801b3db7438 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154609 Sep 19 11:32:20.946657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 561/1113] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:21.055345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:21.057471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:21.064364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.069255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.069255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.069255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.069255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.069670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.096004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:21.096899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8bd48fed-0991-4571-b797-29d4a0521068 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045523 Sep 19 11:32:21.097464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 553/1114] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:21.098441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:21.104892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.105375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.105818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.106515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.106967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.107419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.137868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b7545db2-242b-40c1-bdab-7e38a9a5aad0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045835 Sep 19 11:32:21.138456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 562/1115] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:21.754934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:21.757066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:21.762960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.763481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.763955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.764644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.765091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.765517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.794807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d2c9c9f9-ab35-4999-ab77-be553af2c309 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043843 Sep 19 11:32:21.796039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 554/1116] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:21.970464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:21.971073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:21.977274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.977761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.978200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:21.978893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:21.979382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:21.979820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:22.109677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:22.112376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:22.113648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:22.119847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:22.120375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:22.120818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:22.121530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:22.121727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0296cc25-6250-4b77-bec9-86703d3d56b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155663 Sep 19 11:32:22.122015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:22.122304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 563/1117] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:22.122470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:22.151203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:22.152901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ea1fffb1-a403-4c11-a277-07b5bed1307e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047200 Sep 19 11:32:22.153343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:22.153489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 555/1118] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:22.160021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:22.160501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:22.160935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:22.161686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:22.162085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:22.162627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:22.191145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ec3243fe-5930-486b-bf3e-799c12c6b360 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043924 Sep 19 11:32:22.191731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 564/1119] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:22.808186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:22.810314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:22.817240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:22.817719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:22.818192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:22.818879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:22.819376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:22.819881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:22.849134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c7b4c525-2135-437a-9052-baf595b4078b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044894 Sep 19 11:32:22.849773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 556/1120] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:23.145352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:23.145961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:23.152350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.152824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.153254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.153930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.154378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.155458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.165763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:23.167955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:23.174944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.185589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.185589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.185589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.185589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.186015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.225234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e5450f7b-e7ef-412f-ad8e-e9ad7b5372d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063271 Sep 19 11:32:23.225814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 557/1121] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:23.230957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:23.233709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:23.239594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.240075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.240504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.241763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.241763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.242078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.272899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d8bcc30b-05d7-45a8-adcb-73afcd14a5c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045940 Sep 19 11:32:23.273472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 558/1122] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:23.310652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:23.318577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ebabf850-02e0-4514-b9eb-6a69a2d27c69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.177033 Sep 19 11:32:23.319138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 565/1123] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:23.862123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:23.864283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:23.870287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.870768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.871231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.871918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:23.872369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:23.872791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:23.903377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4f3b0d71-04ae-4f0c-8545-c319fd78a997 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045442 Sep 19 11:32:23.903855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 559/1124] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:24.238425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:24.240599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:24.247121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.247649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.248089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.248784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.249237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.249666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.278540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3db38739-c531-433c-93f7-2a241bd9ea40 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044160 Sep 19 11:32:24.279097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 566/1125] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:24.285834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:24.287955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:24.294214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.294690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.295116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.296494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.296946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.297362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.325435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c0048f7a-f04b-4c4a-8a4d-21df6f276258 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043486 Sep 19 11:32:24.325974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 560/1126] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:24.341610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:24.342289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:24.348731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.349208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.349899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.350322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.350777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.351232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.480457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:24.488307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-40a19f1b-1240-4db9-8c7e-b0f0eb2c94ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150503 Sep 19 11:32:24.488927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 567/1127] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:24.916554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:24.918729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:24.924876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.925355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.925791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.926478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:24.926934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:24.927397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:24.957948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d2b2ed42-6b4f-46ad-8985-6ebcfadc7b38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045464 Sep 19 11:32:24.958502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 561/1128] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:25.291707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:25.293860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:25.301144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.301630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.302060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:25.302760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.303248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.303673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:25.307421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:25.335137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6af32713-1cab-4faa-847a-0dad003548c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047324 Sep 19 11:32:25.335719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 568/1129] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:25.338597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:25.340877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:25.347475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.347956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.348394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:25.349080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.349534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.349957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:25.353548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:25.379982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-75a7a939-77e2-4401-bf73-760eabb90f9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045293 Sep 19 11:32:25.380538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 562/1130] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:25.511585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:25.512275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:25.518191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.518835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.519093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:25.519820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.520274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.520698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:25.657247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:25.665040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f3bd9501-6608-481f-8370-6e87afeb41cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157305 Sep 19 11:32:25.665607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 569/1131] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:25.970983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:25.973089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:25.979650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.980138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.980571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:25.981263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:25.981715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:25.982141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:26.012411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bceeee02-754a-42a9-a14f-cb934f1bca27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045532 Sep 19 11:32:26.012967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 563/1132] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:26.348362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:26.350510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:26.352899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:26.357656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:26.358712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:26.359157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:26.366308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:26.366308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:26.366308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:26.390384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-011b012d-73ea-4277-90cc-294b01c2cc48 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045931 Sep 19 11:32:26.390954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 570/1133] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:26.391712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:26.393903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:26.400641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:26.401129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:26.401568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:26.402274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:26.402740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:26.403183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:26.433464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-83f08956-f141-4f6d-8013-8401827c32c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Sep 19 11:32:26.434025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 564/1134] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:26.688915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:26.689445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:26.695693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:26.696173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:26.696632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:26.697315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:26.697806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:26.698231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:26.830395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:26.838086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b95a2ca6-9cee-4a41-98bb-806f688a4849 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153496 Sep 19 11:32:26.838644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 571/1135] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:27.024692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:27.026992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:27.033290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.033778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.034219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:27.034917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.035419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.035852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:27.065749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-15ace800-c4f5-4fb7-b222-3aec50acee2f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045017 Sep 19 11:32:27.066313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 565/1136] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:27.403136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:27.405433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:27.411928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.412413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.412852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:27.413545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.414005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.414428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:27.445015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-32644951-de61-41ed-8467-4033a84b4a6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045876 Sep 19 11:32:27.445576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 572/1137] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:27.445994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:27.448280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:27.454922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.455428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.455856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:27.456546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.456991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.457409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:27.486567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6f776b63-ba67-4ac4-894f-77956471a65c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044480 Sep 19 11:32:27.487116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 566/1138] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:27.862531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:27.863066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:27.869100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.869594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.870023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:27.870708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:27.871160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:27.871610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:28.018138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:28.025550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-df9e4326-ab50-45cb-a140-46297e2286fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.167556 Sep 19 11:32:28.026123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 573/1139] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:28.079488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:28.081638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:28.087544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:28.088024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:28.088458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:28.089144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:28.089592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:28.090009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:28.124475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-02ed6a6f-63b0-4a77-bde5-d5c7418c9105 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050156 Sep 19 11:32:28.125044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 567/1140] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:28.458750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:28.460841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:28.467457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:28.467934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:28.468365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:28.469055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:28.469497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:28.469910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:28.499060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:28.501282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:28.501874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5ad53d4b-23f6-427b-8be5-e4c270635093 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047043 Sep 19 11:32:28.502446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 574/1141] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:28.508297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:28.508790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:28.509229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:28.509938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:28.510397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:28.510853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:28.541367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3d465b45-935a-49ff-b8fd-5a18603a4a07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046770 Sep 19 11:32:28.541932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 568/1142] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:29.049244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:29.049860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:29.055900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.056388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.056837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.057529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.057987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.058413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.137204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:29.139380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:29.146030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.146515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.146970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.147666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.148114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.148533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.179045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5355221e-1ea9-44cf-84f0-102ea8dd0919 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045777 Sep 19 11:32:29.190547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 569/1143] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:29.195426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:29.203214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-50c5caea-49a4-4ccb-b9fa-247c7e4069e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157763 Sep 19 11:32:29.203779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 575/1144] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:29.514075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:29.516750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:29.523084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.523614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.524061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.524771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.525225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.525672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.553919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:29.556521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:29.560148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0e8a372e-c634-47f6-a433-2be5c20cddeb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050060 Sep 19 11:32:29.560720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 570/1145] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:29.563215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.563709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.564149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.564850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:29.565307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:29.565730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:29.595751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c254ded4-94d6-4d8d-bc91-ad78c25d2af2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Sep 19 11:32:29.596308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 576/1146] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:30.201344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:30.204378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:30.210393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.210892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.211369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.212046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.212490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.212909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.227528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:30.228315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:30.234320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.235332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.235765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.236460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.236908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.237328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.242828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-05766ac0-902a-4c60-a5b5-0d0a18c9bf91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045416 Sep 19 11:32:30.243631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 571/1147] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:30.370279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:30.378669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-12b97393-f0e5-4842-84e7-b384d807206a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155153 Sep 19 11:32:30.379252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 577/1148] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:30.572684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:30.574855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:30.581570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.582092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.582482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.583314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.583727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.584144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.608330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:30.611098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:30.617659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.618204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.618339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-06ac422d-fb64-4e38-869d-65692ab905ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Sep 19 11:32:30.618636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.619084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 572/1149] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:30.619402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:30.619928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:30.620391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:30.650427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3e81e8b8-5157-4794-a913-fa8f59d3540a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Sep 19 11:32:30.650977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 578/1150] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:31.256042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:31.258210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:31.264234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.264712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.265219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.266387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.266839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.267292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.297424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a22e353b-be88-4300-bbf7-d9e096775d48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045422 Sep 19 11:32:31.297969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 573/1151] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:31.401872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:31.402484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:31.408819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.415029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.415029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.415029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.415029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.421244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.546044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:31.554361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fbcc14ee-d4e1-44c9-89a9-340b908f2f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156437 Sep 19 11:32:31.554916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 579/1152] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:31.632887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:31.635052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:31.643745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.644233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.644668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.645360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.645822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.646244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.662488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:31.664829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:31.671119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.671645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.672084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.673447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:31.673900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:31.674322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:31.676885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c1786cf9-ee53-45a1-8d7e-ad5ebbf22c79 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050160 Sep 19 11:32:31.677453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 574/1153] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:31.704133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b69fafc4-c8ad-454b-b9df-63cf6271b690 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045182 Sep 19 11:32:31.704700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 580/1154] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:32.310143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:32.312335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:32.314709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:32.319422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.319900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.320334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.321017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.321468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.321891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.352200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7e00fd37-5d9f-43aa-b353-129ffe277642 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046063 Sep 19 11:32:32.352745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 575/1155] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:32.577886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:32.578499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:32.584803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.585288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.585728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.586413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.586871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.587339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.689948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:32.692295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:32.698522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.699115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.699649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.700416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.700942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.701374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.719119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:32.727922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4c6a04e6-6fb4-4f7d-9f6b-124209cc2f06 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153843 Sep 19 11:32:32.728508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 581/1156] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:32.732698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b65c027d-0bab-4853-a88d-3fae36aa0dc3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047165 Sep 19 11:32:32.733411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 576/1157] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:32.733547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:32.735482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:32.741359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.741848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.742288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.742986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:32.743470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:32.743901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:32.772518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8a02cb08-4e8f-417a-9ae0-25983f1f18de tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042808 Sep 19 11:32:32.773069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 582/1158] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:33.365063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:33.367215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:33.373287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.373791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.374224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.374940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.375412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.375841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.406324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d5b5639f-8b46-4e21-b9de-939dff34f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045304 Sep 19 11:32:33.406875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 577/1159] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:33.745451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:33.747682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:33.751143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:33.755483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:33.755598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.755598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.755776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.756423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.756862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.757294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.758951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.759477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.759912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.760595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.761051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.761470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.787277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bcec325b-1bb6-43f7-9e18-750f1abb25fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045941 Sep 19 11:32:33.787852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 583/1160] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:33.792761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:33.794958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:33.801422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.801912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.802350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.803051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:33.804150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:33.804584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:33.830202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:33.835006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f42a9304-8727-46b7-ac68-e4ca3a0d92c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046031 Sep 19 11:32:33.835620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 584/1161] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:33.891976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:33.895386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:33.900046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ced06506-f65d-471a-a79a-a9e45724b251 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152764 Sep 19 11:32:33.900799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 578/1162] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:34.418625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:34.420823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:34.427620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.428095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.428523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:34.429201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.429646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.430066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:34.460081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b003b612-de28-47f8-8332-b1dd4005840d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045935 Sep 19 11:32:34.460628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 585/1163] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:34.800352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:34.802544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:34.809327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.809808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.810241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:34.810932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.811525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.811953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:34.840942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ac2aea52-099a-4292-a0d1-5f09e1e3dca0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Sep 19 11:32:34.841732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 579/1164] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:34.848068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:34.850268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:34.856226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.856708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.857144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:34.857834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.858287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.858715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:34.888276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-992a79d0-3914-4e81-8590-4135c52d5b66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044659 Sep 19 11:32:34.888832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 586/1165] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:34.923412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:34.924596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:34.930571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.931051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.931558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:34.932251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:34.932706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:34.933131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:35.063407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:35.072597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ad35e7ee-18e5-4638-9233-9cfc73680f5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153133 Sep 19 11:32:35.073165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 580/1166] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:35.473487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:35.475597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:35.482075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:35.482557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:35.482984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:35.483699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:35.484143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:35.484588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:35.514475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d28f1658-0d33-42c9-a22d-00306e5be4bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045643 Sep 19 11:32:35.515031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 587/1167] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:35.853134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:35.855332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:35.862729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:35.863451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:35.863964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:35.864708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:35.865356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:35.865785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:35.896755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-616d960b-0a49-4aa7-b269-15aa0adc05fc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047580 Sep 19 11:32:35.897321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 581/1168] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:35.900708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:35.903022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:35.909852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:35.910326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:35.910757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:35.911567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:35.912013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:35.912433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:35.941420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ace20b92-ab5d-42e7-8450-b07a4f8369c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044624 Sep 19 11:32:35.941983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 588/1169] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:36.096470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:36.097077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:36.103006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.103718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.104101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.104792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.105251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.105679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.237912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:36.246271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a6b8692-b928-460c-b5ec-c6711e46f543 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153701 Sep 19 11:32:36.246841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 582/1170] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:36.527367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:36.529676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:36.536597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.537081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.537524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.538219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.538675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.539101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.568788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-75cc0427-b846-40c9-89f0-8c6c8eb9e264 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045447 Sep 19 11:32:36.569353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 589/1171] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:36.911219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:36.913669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:36.920318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.920789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.921223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.921899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.922379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.922825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.955340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b2e503a4-df2a-44a9-950b-b142ab5ae814 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048423 Sep 19 11:32:36.955923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 583/1172] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:36.957545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:36.959836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:36.965964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.966434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.966867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.967577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:36.968026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:36.968496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:36.999376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5b55fd88-fbe9-47e1-be3e-bd1c08da595b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049330 Sep 19 11:32:36.999937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 590/1173] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:37.270577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:37.271225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:37.277398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:37.277884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:37.278361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:37.279048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:37.279574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:37.279958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:37.416603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:37.425209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e7bdbe6c-d5ad-45fa-8ed8-fb7f10c0d3a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159066 Sep 19 11:32:37.425781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 584/1174] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:37.582543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:37.584748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:37.591123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:37.591649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:37.592090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:37.592785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:37.593243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:37.593671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:37.623282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4185f183-63db-4fa3-a468-d587d9bfb9a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045619 Sep 19 11:32:37.623849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 591/1175] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:37.968362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:37.971087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:37.977521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:37.978057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:37.978431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:37.979114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:37.979592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:37.980041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:38.014324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:38.016587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:38.017761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8ef62388-aef1-4450-b9bc-aee64e73c9ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053261 Sep 19 11:32:38.018740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 585/1176] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:38.022862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:38.023394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:38.023845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:38.024555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:38.025009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:38.025443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:38.060860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-801f5773-73d9-4067-80d3-c3f688323dee tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052273 Sep 19 11:32:38.061428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 592/1177] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:38.550520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:38.551132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:38.557239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:38.557722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:38.558195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:38.558843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:38.559329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:38.559756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:38.636249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:38.638397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:38.646060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:38.646803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:38.647266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:38.648045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:38.648641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:38.649753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:38.700750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e62b31b0-156b-4513-83e6-d63f80f1b321 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060539 Sep 19 11:32:38.700750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 593/1178] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:38.701018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:38.703990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1ea6a7bc-4867-4524-8e14-03968505fd31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.257123 Sep 19 11:32:38.704501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 586/1179] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:39.031676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:39.034428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:39.040426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.040902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.041336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.042240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.042716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.043141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.073354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e6bac5c0-91d5-4a9a-8911-0b61d3433682 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Sep 19 11:32:39.074232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:39.074721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 594/1180] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:39.076310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:39.083244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.083688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.084225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.084934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.085448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.085937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.115754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1327f044-ec8b-4527-86b9-88ac86ba0496 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045777 Sep 19 11:32:39.116328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 587/1181] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:39.706529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:39.708703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:39.715095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.715609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.716052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.716738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.717194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.717621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.727362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:39.727968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:39.734413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.734413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.734761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.735465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:39.735914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:39.736333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:39.747583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c17ff228-54a6-4d7a-90c7-b9af4d9cc525 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045337 Sep 19 11:32:39.748157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 595/1182] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:39.871529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:39.880219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-18cee6a5-4494-4850-9aee-3408719625d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156771 Sep 19 11:32:39.880781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 588/1183] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:40.085862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:40.088164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:40.094215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.094698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.095129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:40.095830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.096288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.097227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:40.127682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5e2c005e-9aaa-4d10-8929-9f9160fd8dd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045712 Sep 19 11:32:40.128249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 596/1184] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:40.128611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:40.130915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:40.137380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.137859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.138292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:40.138980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.139472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.139891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:40.169225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-53023599-b27e-4319-b935-38c08e29c892 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044712 Sep 19 11:32:40.169773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 589/1185] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:40.760073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:40.762319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:40.769458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.769939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.770378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:40.771076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.771553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.771985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:40.802219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7423eb14-e017-497d-a6f3-a4351902ab68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046132 Sep 19 11:32:40.802769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 597/1186] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:40.903491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:40.904097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:40.910092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.910574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.911013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:40.911724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:40.912179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:40.912601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:41.042310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:41.050045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ca9cf448-9a62-4764-972c-becebbb8ef81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150512 Sep 19 11:32:41.051146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 590/1187] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:41.140135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:41.142295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:41.148636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:41.149121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:41.149561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:41.150261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:41.150721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:41.151159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:41.181486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45c5e4a4-6221-45cb-ba61-94775539dcc4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045316 Sep 19 11:32:41.182056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 598/1188] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:41.182369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:41.184620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:41.191649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:41.192130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:41.192566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:41.193253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:41.193703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:41.194123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:41.223665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bc9b4d46-8e89-4094-96af-f45f80a62466 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Sep 19 11:32:41.224521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 591/1189] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:41.814978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:41.817171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:41.823873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:41.824378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:41.824814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:41.825533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:41.825986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:41.826514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:41.856795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3b46046-bd1f-4bd5-bbaf-518832571681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045875 Sep 19 11:32:41.857355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 599/1190] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:42.088034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:42.089052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:42.095619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.096101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.096533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.097233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.097675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.098095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.194907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:42.196930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:42.202959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.203804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.204304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.205065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.205515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.205963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.236655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:42.237168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d1e4967c-61c7-40ff-b81b-2e9af92f0ec4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046987 Sep 19 11:32:42.237532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 600/1191] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:42.242757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:42.244891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:42.245607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c0f90b11-86a2-4143-a941-a7f823c6273e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.164467 Sep 19 11:32:42.246192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 592/1192] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:42.250628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.251106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.251566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.252248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.252758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.253113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.269552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:42.281871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-640426cf-7cde-41c0-8f47-aa24994c1cd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043365 Sep 19 11:32:42.282416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 601/1193] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:42.869644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:42.871842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:42.877825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.878305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.878747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.879465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:42.879920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:42.880350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:42.911754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bac29895-349d-4267-a193-3ca4f9bccfe7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045301 Sep 19 11:32:42.912361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 593/1194] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:43.249753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:43.251912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:43.258542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.259019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.259482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.260170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.260618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.261038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.268906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:43.269507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:43.276219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.276708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.277177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.277883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.278342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.278803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.291329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c3576280-b006-43e2-abb0-ffcb81751a4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045790 Sep 19 11:32:43.291898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 602/1195] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:43.296573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:43.298699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:43.305147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.305623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.306055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.306743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.307206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.307634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.337367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-209c8d63-e2b5-4b35-a9be-f2076d3a0a8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Sep 19 11:32:43.337940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 603/1196] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:43.416500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:43.424427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5df275a7-4014-495e-8ac0-ce054d752574 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159321 Sep 19 11:32:43.424997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 594/1197] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:43.924687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:43.927461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:43.933432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.933915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.934353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.935044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:43.935598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:43.936033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:43.966022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c7006058-3f8a-459c-a1e5-ab6c3f9c1c88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045440 Sep 19 11:32:43.966618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 604/1198] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:44.303231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:44.305369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:44.311799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.312271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.312697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:44.313379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.313829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.314243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:44.331135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:44.344636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8aeadea6-22f5-4444-9fb4-e267b5f7e828 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045390 Sep 19 11:32:44.345197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 595/1199] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:44.350926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:44.353131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:44.359634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.360123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.360562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:44.361262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.361759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.362188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:44.391951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3b097c23-e2c7-436e-83a9-bd45b55e68bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045676 Sep 19 11:32:44.392495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 605/1200] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:44.454479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:44.455088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:44.461689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.462176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.462616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:44.463341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.463801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.464226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:44.592494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:44.600199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87c186fb-df9f-4384-963c-b60e7f44520a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150225 Sep 19 11:32:44.600761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 596/1201] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:44.978172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:44.980339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:44.986515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.986990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.987528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:44.988142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:44.988591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:44.989506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:45.018753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-de7c1bdd-d57e-45e2-8354-c8156a806193 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044671 Sep 19 11:32:45.019331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 606/1202] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:45.359206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:45.361392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:45.368582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:45.369067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:45.369504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:45.370196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:45.370649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:45.371070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:45.399887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-342ed615-b5c5-4216-a233-dc39447d8a04 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044621 Sep 19 11:32:45.400455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 597/1203] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:45.405475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:45.407665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:45.414699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:45.415200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:45.415641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:45.416325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:45.416770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:45.417189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:45.447254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bdaef0b9-c2f4-492a-8585-be248f9fc8d0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Sep 19 11:32:45.447820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 607/1204] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:45.623360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:45.623893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:45.629873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:45.630354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:45.630794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:45.631516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:45.631973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:45.632402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:45.764426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:45.772659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-763e1729-9a59-4f3d-8902-32106dad7bcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153294 Sep 19 11:32:45.773234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 598/1205] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:46.031608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:46.033745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:46.039690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.040165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.040594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.041271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.041715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.042132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.071526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-141f4a9a-7fb0-4dbb-9378-7e7b94e7dfeb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043979 Sep 19 11:32:46.072078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 608/1206] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:46.412411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:46.414590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:46.420955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.421424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.421851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.422545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.422989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.423561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.455015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5bbdf19c-133a-4784-994e-02327f7ca7f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046553 Sep 19 11:32:46.455609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 599/1207] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:46.460336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:46.462486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:46.468968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.469438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.469868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.470539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.470989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.471442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.500996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-759498d2-2bd5-4835-9a41-df2e4776be77 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Sep 19 11:32:46.501563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 609/1208] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:46.796963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:46.797569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:46.804367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.804855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.805289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.805980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:46.806436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:46.806862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:46.936022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:46.943732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-61ce067b-2de6-4b58-b3ed-a94c7719d34e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150998 Sep 19 11:32:46.944295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 600/1209] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:47.085182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:47.087392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:47.093422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.093905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.094339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:47.095070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.095550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.095978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:47.126029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1cb67b8f-3a8b-447d-a8ff-673eab6ce777 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045403 Sep 19 11:32:47.126596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 610/1210] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:47.467508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:47.469580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:47.477707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.478203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.478868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:47.479699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.480305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.481063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:47.513770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:47.516006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:47.523055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.523571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.524012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:47.524713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.525169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.525311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-efd9f368-aad6-4012-8b47-5c72c0059d01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061866 Sep 19 11:32:47.525600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:47.526096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 601/1211] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:47.554421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9b1ef676-b6ed-418d-a905-2511dd47b930 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Sep 19 11:32:47.554978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 611/1212] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:47.967192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:47.967798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:47.973759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.974245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.974684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:47.975653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:47.976259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:47.976709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:48.105172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:48.112987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-049deb30-7fd5-4ad9-aa74-05ff5c6c9fb6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149711 Sep 19 11:32:48.113556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 602/1213] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:48.138098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:48.140286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:48.146332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:48.146817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:48.147293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:48.147980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:48.148432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:48.148859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:48.178398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b8fa2f8b-f7c9-41f4-b9d7-6590c1f499c5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044361 Sep 19 11:32:48.179608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 612/1214] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:48.537923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:48.540644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:48.547152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:48.553282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:48.553282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:48.553282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:48.553282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:48.553682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:48.565865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:48.568125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:48.574603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:48.575084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:48.575571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:48.576251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:48.576704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:48.577131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:48.580780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5e9b9d45-5fa1-4939-873a-870197bbb47a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046800 Sep 19 11:32:48.581675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 603/1215] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:48.606885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e272d5a4-477c-42a2-a045-99c168d998dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044878 Sep 19 11:32:48.607471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 613/1216] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:49.137475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:49.138128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:49.144325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.144808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.145245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.145929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.146382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.146805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.192211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:49.194391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:49.201133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.201621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.202060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.202762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.203490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.203933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.235129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c3ae5f4c-30ab-4784-8e90-bea787db5222 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047051 Sep 19 11:32:49.235733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 614/1217] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:49.280785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:49.288597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a1968d52-027e-47ce-b663-97b8e5f5e946 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155618 Sep 19 11:32:49.289162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 604/1218] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:49.592352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:49.594550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:49.600920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.601393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.601823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.602998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.603471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.603898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.620003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:49.622190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:49.628603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.629096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.629537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.630230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:49.630684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:49.631255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:49.633232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-700b2a90-4c10-4899-bc64-29c7d9696671 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044763 Sep 19 11:32:49.633934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 615/1219] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:49.661032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4f4fb099-242f-401d-ad88-bcc71eb0a9bc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045626 Sep 19 11:32:49.661591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 605/1220] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:50.248134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:50.250300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:50.256156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.256629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.257056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.257734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.258179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.258602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.287557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e208d0d0-830e-492c-9c73-24a2b0ad1921 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Sep 19 11:32:50.288110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 616/1221] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:50.312395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:50.313013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:50.318970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.319492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.319938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.320629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.321085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.321517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.451343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:50.459336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-792e0a07-e1f1-47ef-9c88-c1ffd157a652 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150835 Sep 19 11:32:50.459901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 606/1222] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:50.646123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:50.648404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:50.655420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.655899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.656329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.657013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.657459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.657880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.674056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:50.676244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:50.682765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.683294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.683737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.684437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:50.684893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:50.685316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:50.688301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f40bbc56-12a7-4bb1-ada3-2d208f5dcba3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046409 Sep 19 11:32:50.688870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 617/1223] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:50.715417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4b17732d-98a1-4656-8252-605de005c5c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045282 Sep 19 11:32:50.715961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 607/1224] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:51.300077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:51.302270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:51.309076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.309561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.309996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.310742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.311272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.311748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.315620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:51.342775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-749e04e1-8b74-4280-8432-f3b9ea2da2a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046598 Sep 19 11:32:51.343252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 618/1225] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:51.485067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:51.485762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:51.491932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.492426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.492863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.494390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.494863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.495321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.633662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:51.641565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b95bfcc3-311b-4c37-aa7e-2421556933e1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160465 Sep 19 11:32:51.642141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 608/1226] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:51.701788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:51.704295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:51.711345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.711839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.712279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.712988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.713440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.713865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.731422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:51.733624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:51.740186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.740680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.741130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.741835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:51.742292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:51.742724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:51.751469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b105687c-d937-49da-ac62-9a4e7d287137 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053963 Sep 19 11:32:51.752062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 619/1227] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:51.773226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ed28ecc8-688d-4246-8235-37b06f2a3413 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046294 Sep 19 11:32:51.773786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 609/1228] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:52.364384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:52.366557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:52.369126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:52.373777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.374257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.374701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.375441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.389034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.389034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.405569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4f88cfec-72a0-4b4b-8871-bef6aed45707 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045161 Sep 19 11:32:52.406140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 620/1229] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:52.664976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:52.666149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:52.672221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.672708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.673152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.673834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.674293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.674739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.764139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:52.766455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:52.773236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.773800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.774862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.775757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.776307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.776803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.806120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:52.807097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-31d4a9b3-f6a5-4153-9386-b69033fbda14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046875 Sep 19 11:32:52.807700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 621/1230] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:52.812464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:52.814257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f4a6d52c-99e1-4f44-afdf-bdb4a4652a35 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153279 Sep 19 11:32:52.814725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:52.814835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 610/1231] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:52.820670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.821151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.821735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.822435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:52.822920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:52.823375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:52.852065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ee87b04e-962f-48a4-b01d-a68f1a39babc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043367 Sep 19 11:32:52.853263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 622/1232] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:53.419008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:53.421155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:53.427151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.427669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.428106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.428802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.429256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.429681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.459609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a988aae-3c0d-42ec-a458-c707e6dd4956 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045297 Sep 19 11:32:53.460169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 611/1233] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:53.819670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:53.822445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:53.829187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.829700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.830141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.830837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.831331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.832477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.838531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:53.839143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:53.845566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.846622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.846622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.847194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.847665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.848093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.852183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:53.862777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3715c6c7-88b8-4534-b631-7c74c854391b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047018 Sep 19 11:32:53.863386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 623/1234] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:53.868171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:53.870456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:53.876214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.876817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.877256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.877955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:53.878408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:53.878834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:53.911197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-127f6dc7-23fb-4664-99fa-fe1a7eb2b949 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046737 Sep 19 11:32:53.911791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 624/1235] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:53.996457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:54.004517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-90cc77e6-f8ff-4982-a0ff-ce146392b772 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.170211 Sep 19 11:32:54.005086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 612/1236] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:54.473145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:54.475359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:54.481528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:54.482014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:54.482452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:54.483141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:54.483649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:54.484076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:54.513139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4acc7b38-61f2-4ce9-be24-15eb84d7c1bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044140 Sep 19 11:32:54.513698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 625/1237] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:54.875999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:54.878158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:54.884675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:54.885150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:54.886234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:54.886930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:54.887422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:54.888009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:54.916851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-02080389-4bf1-454d-83dd-9ec4ee79b96f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Sep 19 11:32:54.917408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 613/1238] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:54.924828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:54.927000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:54.933895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:54.934366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:54.934795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:54.935500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:54.935951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:54.936372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:54.965715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b6289438-5aec-41b9-ac08-07e0a4a98303 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044741 Sep 19 11:32:54.966269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 626/1239] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:55.026665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:55.027309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:55.033302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.033783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.034226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:55.034911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.035414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.035843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:55.164967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:55.173589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2c27673c-5bb4-4e8e-bf8b-bb309b062ffd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150740 Sep 19 11:32:55.174158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 614/1240] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:55.525173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:55.527667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:55.537397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.537877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.539753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:55.539753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.539753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.540117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:55.570800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-83e5955e-7b77-49a6-85b2-b1a696a3552e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049681 Sep 19 11:32:55.573424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 627/1241] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:55.929264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:55.931410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:55.937989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.938507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.938942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:55.939673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.940134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.940557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:55.971704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b3fe1ca9-1c70-4779-998e-462d4e87d3d2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046462 Sep 19 11:32:55.972300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 615/1242] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:55.978041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:55.980230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:55.986577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.987062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.987545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:55.988247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:55.988702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:55.989129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:56.018794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e60a6574-7842-416c-bd7c-6c30ff0383b0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044688 Sep 19 11:32:56.019417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 628/1243] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:56.198458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:56.198993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:56.205264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:56.208833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:56.208833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:56.208833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:56.208833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:56.209199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:56.339464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:56.347128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2d9b63c7-08d4-44f8-9d4a-3350f4557578 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153160 Sep 19 11:32:56.347726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 616/1244] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:56.584298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:56.586472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:56.592613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:56.593085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:56.593516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:56.594205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:56.594670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:56.595131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:56.624799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-af6b9f2a-3307-4353-bf36-70948ecab6dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044640 Sep 19 11:32:56.625350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 629/1245] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:56.984922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:56.986999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:56.993656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:56.994145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:56.994729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:56.995961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:56.996418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:56.996846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.026333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-52bc64cd-cd89-443e-a01b-e9551b11bf8c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Sep 19 11:32:57.029632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 617/1246] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:57.031565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:57.033718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:57.040087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.040558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.040983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.041658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.042099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.042518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.071273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-262a3bac-9d0e-45ff-a413-7c166932089b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Sep 19 11:32:57.071817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 630/1247] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:57.369881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:57.370476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:57.376398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.376880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.377309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.377983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.378432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.378847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.513206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:57.520921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8fedba04-3033-4f3f-8840-78614667031a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154997 Sep 19 11:32:57.521484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 618/1248] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:32:57.638821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:57.641000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:57.647553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.648054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.648499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.649211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:57.649663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:57.650086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:57.680683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a7771d63-346f-4b52-afd6-8ae729972673 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046528 Sep 19 11:32:57.681249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 631/1249] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:58.039502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:58.041674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:58.048189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.048668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.049107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.049804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.050259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.050685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.081445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3c5f2872-4645-424f-aa51-a31b4a52de57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046058 Sep 19 11:32:58.082008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 619/1250] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:58.084101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:58.086303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:58.092799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.102237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.102237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.102237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.102237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.102640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.125315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7bfd8270-7f30-4394-b308-a640b10d9b88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Sep 19 11:32:58.125883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 632/1251] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:32:58.544899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:58.545505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:58.552175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.552668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.553109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.553803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.554261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.554690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.683587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:58.692231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0feedadc-04e6-4a2d-ab0e-584aaf3d5d86 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151599 Sep 19 11:32:58.692813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 620/1252] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:32:58.693565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:58.695773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:58.701684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.702165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.702593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.704050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:58.704491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:58.704906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:58.733944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c00fd6c7-ad0e-46fa-af6d-7a11569937a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044303 Sep 19 11:32:58.734495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 633/1253] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:32:59.093923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:59.096131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:59.102512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.104023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.104023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.104237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.104650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.105217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.137326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-687ce7c5-e30b-459c-b68d-6027c44f1f32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047576 Sep 19 11:32:59.138519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:59.139036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 621/1254] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:59.139877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:59.146938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.147453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.147981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.148676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.149131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.149555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.175018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:32:59.179770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4134719d-e683-4915-9b5c-a9e575e140fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046326 Sep 19 11:32:59.184835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 634/1255] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:32:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:32:59.716447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:59.717053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:59.723606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.724090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.724561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.725250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.725705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.726131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.746738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:32:59.749011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:32:59.755102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.755613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.756055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.756751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:32:59.757206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:32:59.757637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:32:59.789140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-49173507-48b0-4d5a-b27a-fcc2f0abf424 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046692 Sep 19 11:32:59.789723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 635/1256] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:32:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:32:59.919076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:32:59.926964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-747dae42-72e8-4ebf-909c-7c5fa39d474a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.214496 Sep 19 11:32:59.927574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 622/1257] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:32:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:00.150074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:00.152289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:00.158623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.159109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.159580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:00.160276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.160734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.161160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:00.191759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bdd5d180-5834-4769-8bd5-9a40e4340831 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045578 Sep 19 11:33:00.192480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 636/1258] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:00.200298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:00.202617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:00.208872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.212853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.212853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:00.212853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.212853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.213245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:00.241787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3031f40a-8670-4f68-b9e2-cc1e9b9fd8c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049479 Sep 19 11:33:00.242461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 623/1259] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:00.801965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:00.804229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:00.810227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.810690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.811126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:00.811848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.812307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.812760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:00.842462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-095d3d9c-2d06-47fa-8b3e-5593141de79a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044497 Sep 19 11:33:00.843029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 637/1260] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:00.951725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:00.952333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:00.958599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.959081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.959575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:00.960259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:00.960713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:00.961207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:01.092985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:01.100770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-77d21543-9ed1-427a-8f24-cb3881441847 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152934 Sep 19 11:33:01.101329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 624/1261] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:01.204031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:01.206188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:01.212680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:01.213166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:01.213791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:01.214413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:01.214874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:01.215345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:01.245563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3747c431-865b-40cf-91a2-575f8530c0a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Sep 19 11:33:01.246119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 638/1262] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:01.254033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:01.256244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:01.258573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:01.264467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:01.264951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:01.265390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:01.266098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:01.266543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:01.266966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:01.296525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9b9da08b-29bc-4c6f-8dd0-506024915dc0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046479 Sep 19 11:33:01.297660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 625/1263] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:01.855800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:01.858001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:01.864086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:01.864566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:01.865004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:01.865703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:01.866158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:01.866585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:01.896183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d6baf41b-d21c-4688-8df2-58d6cccdc73c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044436 Sep 19 11:33:01.896742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 639/1264] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:02.124408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:02.125633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:02.131612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.132169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.132665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.133438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.133958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.134380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.258051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:02.260271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:02.267355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.267842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.268422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.269123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.269574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.270203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.273546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:02.281951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc54d7fa-43bd-40f3-90bc-b82449bfaa81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160807 Sep 19 11:33:02.282534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 626/1265] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:02.303443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a4e8fec-2cf5-43f6-845c-45d54724d77b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049174 Sep 19 11:33:02.304421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 640/1266] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:02.309581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:02.311797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:02.317956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.318445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.319086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.319825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.320284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.320714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.351941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42e74d0a-a769-4f86-b3ee-f35483640597 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046195 Sep 19 11:33:02.352750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 627/1267] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:02.909009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:02.911191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:02.917417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.917901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.918329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.919020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:02.919496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:02.919923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:02.949440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1bf75510-2139-4566-8cc2-2d6eeef2e6e2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044445 Sep 19 11:33:02.949997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 641/1268] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:03.306080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:03.306670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:03.314101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.314585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.315023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:03.315756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.316218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.316399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:03.316825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:03.318538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:03.324835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.325313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.325747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:03.326432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.326876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.327330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:03.357947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-07c189dc-87fd-43c7-877d-161ffdbbfd13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046012 Sep 19 11:33:03.358517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 642/1269] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:03.364980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:03.367140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:03.373058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.373537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.373968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:03.374691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.375754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.376183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:03.405903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4e0d289c-f999-4b04-ba58-5068c039198f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044614 Sep 19 11:33:03.406500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 643/1270] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:03.449805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:03.453568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:03.458215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e00db21d-4aab-4171-949e-a15602538f0b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156204 Sep 19 11:33:03.458790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 628/1271] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:03.963122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:03.965389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:03.972012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.972491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.972925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:03.973612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:03.974060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:03.974481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:04.003572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2ebbb6ad-36ea-4fbf-88cb-8b00d2cd1fbb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044514 Sep 19 11:33:04.004131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 644/1272] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:04.370972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:04.373152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:04.380998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:04.381491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:04.381927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:04.382632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:04.383089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:04.383544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:04.414464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3d80cb3a-12ec-4782-8fd6-588c984160e2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047360 Sep 19 11:33:04.415028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 629/1273] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:04.418773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:04.421001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:04.426979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:04.427491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:04.427926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:04.428616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:04.429065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:04.429490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:04.458986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-835512f5-2391-4de8-ad5b-c4bdb1bae529 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Sep 19 11:33:04.459575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 645/1274] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:04.481743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:04.482452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:04.488428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:04.488914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:04.489353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:04.490043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:04.490496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:04.490926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:04.619541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:04.628097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ffa76e66-b56f-4470-a47b-548ba489e85b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150147 Sep 19 11:33:04.628620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 630/1275] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:05.016569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:05.018750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:05.024810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.025298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.025748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.026442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.026899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.027364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.057221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0684686a-a6d7-4217-b085-cfc5a766cbb4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044967 Sep 19 11:33:05.057777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 646/1276] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:05.427705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:05.429714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:05.436032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.436519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.436956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.437654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.438106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.438531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.469238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-03a9fdcc-34c5-4216-bdcd-22f8eba6cfb2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045508 Sep 19 11:33:05.469816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 631/1277] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:05.472547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:05.474717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:05.481430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.482003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.482435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.483116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.483587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.484008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.513171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-90b3fa62-b33d-4899-b5b8-0a904633392e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Sep 19 11:33:05.513728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 647/1278] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:05.651454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:05.652063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:05.658616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.659099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.659562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.660255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:05.660713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:05.661138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:05.794344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:05.802191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-28755c88-71ee-463f-8922-f147d105ac15 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154612 Sep 19 11:33:05.802761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 632/1279] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:06.069902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:06.072059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:06.078357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.078828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.079293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.079973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.080418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.080836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.109842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-55ede472-34c1-4225-8f08-aead2811cca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043344 Sep 19 11:33:06.110404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 648/1280] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:06.481633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:06.483842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:06.491000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.492990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.492990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.492990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.493399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.493501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.524932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c36797ca-142b-4757-a7f3-d6cced1d14c9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047356 Sep 19 11:33:06.525778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 633/1281] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:06.526603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:06.528773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:06.535914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.536523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.536899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.537606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.538060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.538543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.568322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-91e268f5-a483-4964-9b9b-c951cc2c634d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046270 Sep 19 11:33:06.568884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 649/1282] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:06.826011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:06.826582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:06.833376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.833854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.834310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.834986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:06.835465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:06.835886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:06.966261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:06.974140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5238778e-3eea-4e20-aaee-2528e577b0ae tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152066 Sep 19 11:33:06.974698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 634/1283] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:07.122121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:07.124318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:07.130884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.131421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.131864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.132554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.133013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.133444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.162426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a8dbe9b1-d0a9-4fdc-b727-1e02320bcc78 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044290 Sep 19 11:33:07.162976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 650/1284] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:07.538484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:07.540672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:07.547831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.548313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.548754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.549442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.549905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.550333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.581525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-37c3a763-0c9e-4b51-be87-22f64283934d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Sep 19 11:33:07.581998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:07.582485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 635/1285] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:07.585000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:07.591611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.592106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.592552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.593255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:07.594354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:07.594784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:07.614737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:07.629565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4f9b056f-5bd4-4f24-b1e2-2a39696ed5e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052376 Sep 19 11:33:07.630876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 651/1286] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:07.997990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:07.998596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:08.005118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.005598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.006031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.006704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.007151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.007592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.142613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:08.150409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8811a91e-a5e7-4c9d-a856-9d2cedd7d5f4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156336 Sep 19 11:33:08.150977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 636/1287] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:08.175193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:08.177352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:08.183873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.191368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.191368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.191368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.191368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.191742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.216774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a0baa28c-b304-4262-865f-31bff145f88c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046156 Sep 19 11:33:08.217332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 652/1288] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:08.595013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:08.597682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:08.604180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.604670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.605108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.605802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.606257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.606685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.636050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a14ca863-9fc7-4f03-a657-a0cd79eccbf6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045709 Sep 19 11:33:08.636704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 637/1289] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:08.642297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:08.644526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:08.650805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.651323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.651756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.652437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:08.652882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:08.653304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:08.681938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d69cbf9e-ec99-4bf1-a638-68c4640122a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044179 Sep 19 11:33:08.682487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 653/1290] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:09.174523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:09.175130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:09.181329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.181848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.182285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.182974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.183462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.183888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.230286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:09.232632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:09.239133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.239650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.240094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.240787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.241241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.241668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.272256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cded7071-15ed-48c2-8b0c-9ee39850db52 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046032 Sep 19 11:33:09.272817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 654/1291] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:33:09.316814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:09.324551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-85002ca8-596a-4ad6-bab8-a93945c4d058 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154527 Sep 19 11:33:09.325111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 638/1292] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:09.649237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:09.651420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:09.658783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.660864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.660864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.662601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.663086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.663555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.694396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0f453d7f-1d28-49b3-af52-1fe77be74f14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049125 Sep 19 11:33:09.694967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 655/1293] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:09.696137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:09.699448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:09.708903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.709615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.710261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.711324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:09.712010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:09.712647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:09.747905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b7473d20-26e2-4cca-86b7-fde1121cfeb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057409 Sep 19 11:33:09.748475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 639/1294] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:10.285689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:10.287860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:10.293810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.294291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.294728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.295447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.295896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.296321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.326486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-be2756dd-cc16-430b-b0c8-2c6ed17aa593 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045310 Sep 19 11:33:10.327043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 656/1295] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:10.416513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:10.417036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:10.424247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.424724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.425154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.425846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.426288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.426707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.558326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:10.566023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e0c7bb01-16fb-45f9-97e6-7c23c18424ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153533 Sep 19 11:33:10.566596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 640/1296] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:10.707850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:10.709910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:10.716272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.716749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.717189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.717875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.718330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.718752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.747912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cadf8648-bbc8-46d1-9fce-ac8c73dae72c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Sep 19 11:33:10.748454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 657/1297] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:10.760921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:10.763153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:10.769650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.770136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.770575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.771304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:10.771763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:10.772188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:10.801300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87c88ecd-54af-422f-a45c-a357b4a05fc2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044322 Sep 19 11:33:10.801868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 641/1298] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:11.339829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:11.342019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:11.348126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.348542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.348980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.349680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.350134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.350560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.381138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-68c71d29-c5ac-4cc7-b980-92ab1aca16a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045453 Sep 19 11:33:11.381695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 658/1299] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:11.589476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:11.590180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:11.596568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.597057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.597492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.598571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.599006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.599461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.735558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:11.743416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1458adfc-cbce-4e31-bb36-f6062e53b43f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157764 Sep 19 11:33:11.743980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 642/1300] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:11.760649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:11.762800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:11.769164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.769641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.770078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.770772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.771268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.771696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.811588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-485161b7-274a-421b-8751-8d8e15a4d8bd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054829 Sep 19 11:33:11.812148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 659/1301] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:11.813699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:11.815916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:11.821938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.822416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.822881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.823573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:11.824023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:11.824446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:11.853866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c056f3c3-9fa5-4b84-9c7f-97ea800088a1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043966 Sep 19 11:33:11.854331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 643/1302] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:12.394318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:12.396411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:12.402415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.402897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.403368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.404072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.404525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.404950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.436194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3f01f08-26c7-4c77-904d-154995633d3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046355 Sep 19 11:33:12.436810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 660/1303] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:12.767256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:12.767885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:12.774737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.775293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.775746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.776469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.776934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.777364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.824268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:12.826449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:12.833424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.833908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.834344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.835145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.835757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.835982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.868731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1e7e3e17-3381-419d-936a-4e7df343bd3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047666 Sep 19 11:33:12.868731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 661/1304] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:12.873278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:12.875479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:12.882139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.882625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.883062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.883784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:12.884235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:12.884662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:12.914219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-89040f49-bf14-4fab-b50b-af9b2f127d90 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Sep 19 11:33:12.914700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 662/1305] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:12.923353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:12.931149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ddd959e0-f96f-45d9-8495-c3997c7f7f2d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.168562 Sep 19 11:33:12.931746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 644/1306] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:13.449561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.451708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.467160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.467667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.468095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.468797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.469240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.469658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.502340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-30d7e1d1-5622-4024-a026-ea24bf18d9d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056842 Sep 19 11:33:13.502906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 663/1307] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:13.880999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.883162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.889639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.890130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.890567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.891318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.891776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.892202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.909312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:13.923255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6e07f11d-0e98-4ed1-aad4-3589b8f6866a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045532 Sep 19 11:33:13.929914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 645/1308] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:13.930484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.930484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.935587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.936162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.936589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.937355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.937802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.938221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.954772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:13.955413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:13.961824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.962316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.962834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.963480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:13.963946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:13.964371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:13.968626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-08ba67d9-06b9-428b-8e55-6ae3abe0be66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046507 Sep 19 11:33:13.969763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 664/1309] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:14.098258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:14.106264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd631b88-1810-4611-9d29-49261e817c31 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155614 Sep 19 11:33:14.106835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 646/1310] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:14.514138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:14.516871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:14.529020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.529512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.529950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.530744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.531106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.531549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.562389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7dd4d9ae-3e48-41d3-8cec-c28cc120431e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052106 Sep 19 11:33:14.563666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 665/1311] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:14.935883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:14.938487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:14.944952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.945441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.945881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.946577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.947033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.947495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.979570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4bd942c1-d4dc-4bc5-9e30-5e3a4b7ae783 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047679 Sep 19 11:33:14.980139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 647/1312] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:14.982007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:14.984226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:14.990565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.991079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.991570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:14.992257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:14.992700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:14.993119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:15.023360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3a8cb09f-3100-44cd-8b11-d978cc76a0d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045158 Sep 19 11:33:15.023919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 666/1313] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:15.130350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:15.130964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:15.136913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:15.137395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:15.137829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:15.138514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:15.138971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:15.139429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:15.268008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:15.275698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-67c77927-cd33-465c-b2d5-39760c4696bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149163 Sep 19 11:33:15.276266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 648/1314] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:15.575089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:15.577277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:15.583712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:15.584198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:15.584634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:15.585325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:15.585781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:15.586207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:15.616618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-19f28b71-b430-4a11-b69a-cf2b9531a9e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045509 Sep 19 11:33:15.617172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 667/1315] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:15.992479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:15.994688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:16.001275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.001759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.002201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.002896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.003382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.003810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.033744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2b853a9a-bac3-44ad-a9cb-d69bb67f18b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045337 Sep 19 11:33:16.034465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 649/1316] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:16.036564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:16.038740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:16.045170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.045636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.046069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.046750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.047259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.047669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.051322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:16.076822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b2879bee-7a6d-42f6-899f-52b9477d4450 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044811 Sep 19 11:33:16.077397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 668/1317] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:16.299088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:16.299725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:16.305603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.306080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.306516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.307213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.307673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.308095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.440076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:16.447793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e6d810ac-abef-46e5-b789-58eef9ee2037 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152641 Sep 19 11:33:16.448361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 650/1318] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:16.630175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:16.633751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:16.641173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.641741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.642200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.642973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:16.643456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:16.643888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:16.674848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-233fd3ae-bdc2-4f87-87f4-cd815147c150 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049546 Sep 19 11:33:16.675453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 669/1319] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:17.046247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:17.048463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:17.055632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.056121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.056563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.057258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.057714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.058145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.088142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-24e73c4b-d4e2-46c2-90c1-eb09de18a0fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045941 Sep 19 11:33:17.088746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 651/1320] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:17.090267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:17.092465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:17.094747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:17.099994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.100481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.100911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.101606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.102056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.102475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.133379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce3ff081-f486-4594-9210-7ab21642d139 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047208 Sep 19 11:33:17.133933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 670/1321] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:17.471909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:17.472443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:17.478430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.478912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.479391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.480074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.480536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.480953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.611559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:17.619244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-337fcfae-f6a6-4a51-bc92-f1b1db7933e6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151378 Sep 19 11:33:17.623102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 652/1322] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:17.688073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:17.690848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:17.697715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.698293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.698790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.699607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:17.703951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:17.703951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:17.732575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7380eca1-0453-41ce-8653-a41c9ade7fc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047796 Sep 19 11:33:17.732575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 671/1323] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:18.100731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:18.102863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:18.109977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.110464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.110900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.116132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.116132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.116132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.145175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ab7ddb84-c90e-4320-82a0-4883c09e8afb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048379 Sep 19 11:33:18.145737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 653/1324] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:18.146117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:18.148370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:18.154621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.155096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.155792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.156505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.156956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.157372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.186170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a780bf46-7862-4f03-8698-1d704d38bbf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044139 Sep 19 11:33:18.186716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 672/1325] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:18.643484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:18.644095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:18.651005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.651511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.651952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.652641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.653096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.653517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.744690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:18.747137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:18.753256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.753740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.754182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.754886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:18.755668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:18.755922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:18.783724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:18.787069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d40159a5-73c2-4292-a6a5-0b7aeb614d0f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046401 Sep 19 11:33:18.787677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 673/1326] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:18.791596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e86a1587-9952-47d5-9135-7dcffacb2064 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152039 Sep 19 11:33:18.792158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 654/1327] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:19.157647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:19.160380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:19.166715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.167222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.167665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.168347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.168803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.169220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.198387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9468da17-ac50-454f-b06c-a0d2c58ac8a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044694 Sep 19 11:33:19.198946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 674/1328] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:19.206075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:19.208269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:19.214971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.215486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.215927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.216620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.217079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.217505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.247870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a06a1225-bf44-46b6-ab3a-3d2c1b95a3f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046001 Sep 19 11:33:19.248432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 655/1329] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:19.800120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:19.802292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:19.808313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.808791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.809229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.810044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.810503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.811046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.814869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:19.815580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:19.821485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.821970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.822493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.823100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:19.823601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:19.824077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:19.841578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fde21c21-fcc8-41ee-8828-fbf9f75baa40 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045918 Sep 19 11:33:19.842152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 675/1330] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:19.957730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:19.965669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6636ad36-d952-46e9-a292-4f2ad61cb890 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155237 Sep 19 11:33:19.966247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 656/1331] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:20.211968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:20.214225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:20.220880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.221502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.221908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:20.222621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.223062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.223508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:20.253457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c47adc03-d959-47b1-b82a-051fc9646ca6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Sep 19 11:33:20.254004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 676/1332] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:20.260980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:20.263200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:20.269606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.270093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.270527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:20.271244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.271703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.272129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:20.300929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2267c8ff-2e8f-4175-a8f8-0f2853f685d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043837 Sep 19 11:33:20.301499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 657/1333] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:20.854219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:20.856404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:20.863021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.863531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.863973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:20.864665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.865118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.865544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:20.894377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8131adc8-d11a-414d-a46e-fb76ddb9ef5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044169 Sep 19 11:33:20.894941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 677/1334] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:20.990216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:20.990866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:20.996869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.997354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.997794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:20.998486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:20.998944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:20.999403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:21.131959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:21.140148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1d4757e1-5621-4837-b335-7613773dafb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154473 Sep 19 11:33:21.140750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 658/1335] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:21.265815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:21.268525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:21.275069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:21.275587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:21.276062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:21.276760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:21.277214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:21.277643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:21.308942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d568235-2c54-4aa0-94a3-c7fd6c199fcf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047011 Sep 19 11:33:21.309513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 678/1336] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:21.313734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:21.316632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:21.323109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:21.323622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:21.324177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:21.324852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:21.325299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:21.325712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:21.356811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ad9b912a-9c5c-48fb-a0ad-41efaa5362ad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047120 Sep 19 11:33:21.357374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 659/1337] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:21.907137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:21.909318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:21.915277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:21.915751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:21.916197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:21.916857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:21.917304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:21.917727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:21.947330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-baafa4a4-2fec-4abc-892a-4c5dcad3a737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044089 Sep 19 11:33:21.947881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 679/1338] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:22.164331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:22.164840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:22.170827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.171385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.171818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:22.172525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.172974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.173397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:22.322082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:22.324531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:22.332433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.332928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.333372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:22.334085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.334550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.334982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:22.367133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1ca09de6-f23a-4d83-b72c-8294ad9386e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049116 Sep 19 11:33:22.367756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 680/1339] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:22.372552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:22.374742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:22.381470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.381956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.382394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:22.383110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.383596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.384024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:22.416309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-be74fdae-a2ab-4215-a085-8e7446c5095e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047348 Sep 19 11:33:22.416794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 681/1340] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:22.525377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:22.533155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ca0cd7d1-cc6b-4aa4-ad72-82f1db45db54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.372844 Sep 19 11:33:22.533717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 660/1341] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:22.960102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:22.962278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:22.968345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.968831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.969269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:22.969956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:22.970403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:22.971387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:23.000835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b9502140-ec75-4764-b091-907c6d918294 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044731 Sep 19 11:33:23.001390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 682/1342] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:23.379435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:23.381601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:23.388101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:23.388590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:23.389034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:23.389723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:23.390181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:23.390615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:23.421212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eed0c3ae-a88e-4767-a516-08fbde880a5a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045791 Sep 19 11:33:23.421779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 661/1343] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:23.431365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:23.433530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:23.439928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:23.440413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:23.440853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:23.441544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:23.441994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:23.442421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:23.472189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c7fdfde5-b8f1-4a4e-b585-32d082f726d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Sep 19 11:33:23.472744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 683/1344] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:23.556307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:23.556913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:23.562921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:23.563432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:23.563868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:23.564552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:23.565009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:23.565427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:23.569304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:23.695716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:23.703841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d6912d9b-aa0a-40d4-8249-2302fc3854c1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151460 Sep 19 11:33:23.704446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 662/1345] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:24.013367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:24.015552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:24.021596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.022074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.022510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.023295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.023753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.024177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.048585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:24.053803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-400374ec-56e7-4590-9f45-8877e85c7826 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044474 Sep 19 11:33:24.054368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 684/1346] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:24.433334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:24.435464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:24.441946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.442466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.442906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.443630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.444087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.444516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.473939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-16d0f1ab-1594-4d5e-ba79-5492de4b77d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044753 Sep 19 11:33:24.474495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 663/1347] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:24.484817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:24.487797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:24.494420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.494911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.495369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.496049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.496493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.496908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.525825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eb52cbc6-c02b-47a9-b51b-aca72d3289e3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Sep 19 11:33:24.526414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 685/1348] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:24.728107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:24.728652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:24.734575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.735058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.735533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.736220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:24.737332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:24.737760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:24.877872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:24.885629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b48270b6-7c31-402c-83bb-1e8abdbca872 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.161514 Sep 19 11:33:24.886197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 664/1349] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:25.066478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:25.068642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:25.074517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.074989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.075461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:25.076170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.076615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.077031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:25.108424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4d0bae9-c1e2-40f8-b19b-d32f2cb42453 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045201 Sep 19 11:33:25.108424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 686/1350] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:25.486126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:25.488979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:25.495520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.496032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.496442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:25.497138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.497728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.498180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:25.528367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd43c69a-df11-4eaa-a648-29ffeca777cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046250 Sep 19 11:33:25.528929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 665/1351] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:25.537898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:25.540146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:25.546744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.547240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.547679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:25.548373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.549384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.549856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:25.579051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7190cc53-3e89-4f95-9f86-8649f7dc11e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Sep 19 11:33:25.579635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 687/1352] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:25.909532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:25.910125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:25.916122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.916606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.917044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:25.917727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:25.918182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:25.918605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:26.046524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:26.054811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b3cf8e4e-88e1-4ad9-a7bd-b0fa66c1f826 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149743 Sep 19 11:33:26.055409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 666/1353] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:26.120508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:26.122671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:26.128768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:26.129208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:26.129642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:26.130324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:26.130785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:26.131228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:26.160944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-62e81cc1-466f-4e0a-a57d-750a0e7aa64e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044433 Sep 19 11:33:26.161508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 688/1354] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:26.541290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:26.543491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:26.550402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:26.550889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:26.551365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:26.552063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:26.552521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:26.552950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:26.583427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5ebc12e5-b3e4-42ca-a6e4-3868edd2de47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046128 Sep 19 11:33:26.584004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 667/1355] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:26.591584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:26.593755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:26.600895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:26.601380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:26.601852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:26.602546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:26.602998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:26.603470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:26.633542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-069d9712-fc70-400f-800d-8f34e97f59d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045996 Sep 19 11:33:26.634100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 689/1356] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:27.078301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:27.078935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:27.085698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.086186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.086621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.087361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.087820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.088249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.174065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:27.176340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:27.182215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.182693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.183124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.183837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.184285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.184703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.215545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-46f3c73d-0d17-426c-8105-fd379e9a6724 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045331 Sep 19 11:33:27.216102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 690/1357] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:33:27.223757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:27.231679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-19e1039d-b5a2-4372-bf1b-6a80ef05bdf2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157667 Sep 19 11:33:27.232246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 668/1358] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:27.595286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:27.597946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:27.604327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.604812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.605254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.605939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.606394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.606821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.636225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-abce9de6-a577-4230-950b-d9b4970d0ccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044935 Sep 19 11:33:27.641776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 691/1359] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:27.646072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:27.648340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:27.654699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.655202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.655648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.656337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:27.656802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:27.657230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:27.687143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f1e484a6-ff2d-4ced-9da6-ca9350e26211 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045128 Sep 19 11:33:27.688430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 669/1360] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:28.228626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:28.230942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:28.237490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.238091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.238533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.239253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.239716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.240189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.254354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:28.255211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:28.261894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.262377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.262816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.263557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.264011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.264550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.271987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-008cd6d8-f067-4531-95f6-65faff8d64c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047346 Sep 19 11:33:28.272571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 692/1361] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:28.394860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:28.402704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c7647d06-1c4e-42fb-9993-dcbfb5035b08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152619 Sep 19 11:33:28.403287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 670/1362] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:28.648682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:28.650752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:28.657133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.657620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.658061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.658817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.659303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.659737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.689340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-88ab88f5-1056-42d4-b8dd-83e01a6e45cb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044721 Sep 19 11:33:28.690451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 693/1363] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:28.699752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:28.701949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:28.708766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.709254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.709724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.710416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:28.710870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:28.711360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:28.741878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3f36be94-3096-4aa3-98e9-3baeed31929b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045982 Sep 19 11:33:28.750856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 671/1364] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:29.284054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:29.286322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:29.293705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.294181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.294610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.295331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.295784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.296199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.329324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-11964c31-6e9f-445a-8c4a-bcee92bd4ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049236 Sep 19 11:33:29.329889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 694/1365] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:29.426558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:29.427110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:29.433215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.433702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.434140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.434876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.435378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.435807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.576385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:29.586043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1e403032-5e73-4c10-b174-9448a51fbb3d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.163711 Sep 19 11:33:29.587042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 672/1366] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:29.702819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:29.704913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:29.713579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.714063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.714504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.715240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.715728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.716153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.747764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-618a3f53-4e69-4008-a4af-4011c1a21230 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049270 Sep 19 11:33:29.748323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 695/1367] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:29.763127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:29.765313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:29.771761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.772245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.772675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.773365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:29.773812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:29.774236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:29.805402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f8ecbaae-34f3-424c-bc52-bd05f76aacdb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046209 Sep 19 11:33:29.806070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 673/1368] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:30.343053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:30.345263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:30.351747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.352219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.352648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.353331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.353767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.354184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.384168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c66d68d6-ebc9-4cfd-ba46-ab3a9850628c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044984 Sep 19 11:33:30.384657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 696/1369] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:30.609864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:30.610483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:30.617180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.617574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.618014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.618710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.619191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.619744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.752351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:30.760204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ca9c43a8-1894-4c61-a603-cbb12565309e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154158 Sep 19 11:33:30.760390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:30.760871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 674/1370] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:30.762734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:30.769768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.770244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.770832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.771558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.772003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.772423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.802734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0c2bdc3e-ccee-453e-9d06-34f86264d7fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046335 Sep 19 11:33:30.803307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 697/1371] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:30.818022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:30.820202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:30.822533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:30.827502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.827990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.828429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.829120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:30.829576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:30.830004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:30.860264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5b3a4679-2eba-4e1e-acd6-6db57e6e769b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046193 Sep 19 11:33:30.860857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 675/1372] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:31.397278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:31.399501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:31.405539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.406277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.406456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.407189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.407646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.408100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.437637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d5524be0-3e51-4446-9bf2-dd4de93366cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044966 Sep 19 11:33:31.438190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 698/1373] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:31.783767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:31.784404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:31.790389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.790861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.791320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.791999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.792447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.792863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.815986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:31.818173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:31.824669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.825164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.825603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.826301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.826758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.827478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.863758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a1338fe1-293c-4941-a1ea-8e6e25be5e4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052242 Sep 19 11:33:31.864343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 699/1374] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:31.872782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:31.875293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:31.881233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.881728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.882165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.882861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:31.883350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:31.883819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:31.914317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cdbf840f-6f72-47a1-8c5c-64b0d8552c31 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045247 Sep 19 11:33:31.915086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 700/1375] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:31.928463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:31.936170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d2d3d966-379f-48af-b7fd-928ad6154195 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156290 Sep 19 11:33:31.936766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 676/1376] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:32.451057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:32.453445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:32.460006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.460497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.460936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.461627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.462079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.462508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.479466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:32.492130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-64574fdc-6dce-44c8-9383-5e49728a3e74 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045191 Sep 19 11:33:32.492689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 701/1377] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:32.876822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:32.879535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:32.886012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.886496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.886929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.887659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.888120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.888547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.918593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d5b46490-c3c8-4adb-9fe2-8a88403bd91f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Sep 19 11:33:32.919182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 677/1378] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:32.927193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:32.929505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:32.936352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.936838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.937275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.937970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.938428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.938860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.959483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:32.960088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:32.965991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.966478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.966921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.967648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:32.968100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:32.968566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:32.969796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bd378405-64ce-4ec3-90da-d077722d3dc5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046633 Sep 19 11:33:32.970402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 702/1379] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:33.100733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:33.104307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:33.111002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-29c10987-63f8-4c82-ad52-2389d9ee92a5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153900 Sep 19 11:33:33.111002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 678/1380] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:33.504775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:33.506923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:33.512908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.513384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.513820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:33.514511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.514961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.515413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:33.544328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-da26271e-bdf6-4acd-9216-b6b184f789ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043553 Sep 19 11:33:33.544881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 703/1381] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:33.930723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:33.932840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:33.939812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.940298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.940740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:33.941424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.941879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.942304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:33.973123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-283a681d-4196-4342-a7d7-068db239195d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046472 Sep 19 11:33:33.973695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 679/1382] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:33.981870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:33.984059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:33.990395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.990914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.991392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:33.992087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:33.992534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:33.992959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.022376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9c837bf4-e201-42e2-8980-0b001dc56b99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044422 Sep 19 11:33:34.022937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 704/1383] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:34.133804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:34.134452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:34.140483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.140969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.141410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.142101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.142560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.143685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.272431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:34.280146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0646fdf1-c9ee-4ec7-9128-85e0b8a38dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150335 Sep 19 11:33:34.280715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 680/1384] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:34.557844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:34.560086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:34.566813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.567325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.567761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.568450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.568909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.569337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.599947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c1381add-542c-4682-afb0-270d4d9603eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046066 Sep 19 11:33:34.600498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 705/1385] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:34.985283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:34.987956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:34.994367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.994845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.995319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:34.996013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:34.996470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:34.996871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.026003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-be38182d-f5e1-4a3b-b970-90afb394ccbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Sep 19 11:33:35.026558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 681/1386] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:35.034463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:35.036662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:35.042644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.043128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.043601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.044294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.044757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.045185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.074177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a3f8d4fb-8dfc-4d22-b20b-adcb08e16e28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044215 Sep 19 11:33:35.074738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 706/1387] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:35.303067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:35.303699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:35.309554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.310031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.310461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.311135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.311611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.312028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.440859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:35.448730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1644aef7-5e23-4647-9815-52696441d11a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149531 Sep 19 11:33:35.449303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 682/1388] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:35.612291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:35.614361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:35.620993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.621472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.621907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.622594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:35.623048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:35.623515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:35.653478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dfe2630e-c97c-4734-95eb-70be2515b392 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045251 Sep 19 11:33:35.654031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 707/1389] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:36.038773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:36.041052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:36.047819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.048308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.048743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.049437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.049890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.050313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.079631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a8356000-23ee-437b-9c9e-0025c4f6de64 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044760 Sep 19 11:33:36.080694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 683/1390] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:36.087301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:36.089447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:36.095386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.096512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.096949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.097629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.098081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.098501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.127727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f20acbf2-420c-428c-b892-075f22cdef82 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Sep 19 11:33:36.128277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 708/1391] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:36.472614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:36.473144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:36.479409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.479890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.480321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.481071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.481515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.481934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.629681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:36.637735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6ed5798c-200a-4a13-ac97-0b95174a1c10 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.169057 Sep 19 11:33:36.638308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 684/1392] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:36.666224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:36.668558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:36.675277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.675861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.676297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.676994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:36.677449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:36.677875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:36.709127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb518148-df6f-4e63-9be6-efddd3ba3c2c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047062 Sep 19 11:33:36.712696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 709/1393] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:37.092944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:37.095188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:37.102139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.102622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.103060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.103784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.104241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.104662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.135009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5310bce9-8873-4379-baa5-3f4cba0ebd2c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046002 Sep 19 11:33:37.135790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 685/1394] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:37.140375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:37.142557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:37.148649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.149133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.149572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.150265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.150717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.151144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.180780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5bbfcf56-6285-4717-b7bf-2e11d5ff2627 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044311 Sep 19 11:33:37.181340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 710/1395] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:37.662395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:37.663002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:37.669005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.669493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.669929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.670622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.671079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.671536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.723351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:37.725494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:37.732444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.733225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.733372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.734082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:37.734536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:37.734973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:37.766476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-29e4f225-ee40-4486-90f4-03e663c32ee1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048097 Sep 19 11:33:37.767057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 711/1396] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:33:37.804409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:37.812097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a63b4dc-7d76-4cd2-bdff-552b09cb7550 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154341 Sep 19 11:33:37.812665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 686/1397] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:38.147556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:38.149745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:38.155662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.156146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.156589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.157317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.157775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.158202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.188729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5eb671b8-479a-404d-84b0-0db3ee94dbec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045153 Sep 19 11:33:38.189295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 712/1398] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:38.193220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:38.195444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:38.202314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.202821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.203301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.203986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.204434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.204853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.234432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc4475c5-56c2-476d-bd9e-aad9f24edf12 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 Sep 19 11:33:38.234988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 687/1399] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:38.779788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:38.781940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:38.788408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.788882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.789316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.790000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.790449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.790872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.821745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe42becb-f6b1-4740-82a5-7758bfcc8585 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046063 Sep 19 11:33:38.822304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 713/1400] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:38.836324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:38.836932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:38.842844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.843379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.843820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.844514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:38.844970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:38.845397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:38.979839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:38.987799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-718e9b6e-a034-4ea7-9ab8-2ec069b5282d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155281 Sep 19 11:33:38.988370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 688/1401] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:39.201381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:39.203853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:39.210391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.210991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.211456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.212153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.212609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.213033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.242665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0a43bd30-a6db-4bc9-b070-9faa04e08616 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045271 Sep 19 11:33:39.243241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 714/1402] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:39.246217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:39.248395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:39.254386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.254862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.255326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.256015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.256466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.256888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.287021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce92942e-2499-4bf3-8918-b1ec22b08304 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044965 Sep 19 11:33:39.287605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 689/1403] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:39.834687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:39.836913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:39.843310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.843789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.844226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.844912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:39.845396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:39.845828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:39.875355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a0fa8d06-7bdc-40e1-81b2-f7e1b1c0ee2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045202 Sep 19 11:33:39.875911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 715/1404] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:40.009813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:40.010413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:40.016936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.017448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.017878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.018561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.019541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.019958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.150161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:40.158004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5c31dbf6-47f0-4a08-8c19-9e3571ff3082 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152077 Sep 19 11:33:40.158566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 690/1405] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:40.255763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:40.257947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:40.264059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.264553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.265003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.265704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.266191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.266622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.298414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f75c7884-ada1-44e8-ba32-26587cf12d14 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047085 Sep 19 11:33:40.299346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 716/1406] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:40.304135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:40.306322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:40.312525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.313042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.313458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.314163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.314618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.315048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.347163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c09e5d94-29cb-42bb-9cc9-4114ea30f822 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046792 Sep 19 11:33:40.347690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 691/1407] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:40.888271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:40.890599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:40.897117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.897595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.898028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.898748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:40.899231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:40.899659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:40.929709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6b1a6570-fa5c-4215-ab31-c56186d94c18 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045500 Sep 19 11:33:40.930269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 717/1408] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:41.181803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:41.182352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:41.188761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.189235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.189666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.190353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.190807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.191250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.311400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:41.313719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:41.319932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.320419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.320866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.321566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.322020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.322445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.326267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:41.329265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:41.338010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-274885c4-f597-4900-90aa-bd890e3f638e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160180 Sep 19 11:33:41.342080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 692/1409] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:41.353502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8427832f-da85-4905-a2c8-6719b36046e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046174 Sep 19 11:33:41.354066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 718/1410] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:41.359695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:41.361931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:41.367932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.368420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.368945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.369558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.370027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.370452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.400365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8e9567cb-476d-42cd-b9f8-d36c0c247951 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044676 Sep 19 11:33:41.400942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 693/1411] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:41.944286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:41.946503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:41.953493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.954052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.954493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.955217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:41.955674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:41.956104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:41.986383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6695c74a-524f-478b-9efd-0190b662fafc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047884 Sep 19 11:33:41.986956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 719/1412] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:42.362790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:42.363430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:42.365710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:42.367895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:42.369641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.369782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:42.370128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.370706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:42.371446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.371906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.372339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:42.374382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.374859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.375323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:42.376049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.376502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.378691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:42.408816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0e4d4b3d-ea2b-4245-9ada-03123ed69e94 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047028 Sep 19 11:33:42.409425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 720/1413] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:42.414258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:42.416474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:42.422424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.422890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.423374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:42.424045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:42.424489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:42.424915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:42.454543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6bfbef51-fb78-466c-a40a-9a81befb5d80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044105 Sep 19 11:33:42.455107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 721/1414] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:42.505515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:42.513318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-99ab6b16-56dc-4d6a-9510-9d8ad06b6017 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154537 Sep 19 11:33:42.513915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 694/1415] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:42.999728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.001940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.008348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.008828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.009293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.009983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.010435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.010859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.042032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d64c7ad-ed66-4183-b926-1af31b2383ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046331 Sep 19 11:33:43.042607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 722/1416] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:43.421385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.423494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.430178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.430662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.431098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.431814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.432264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.432682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.449393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:43.462856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e7ad20ac-4fa7-49b8-9e89-813b495e8e00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045522 Sep 19 11:33:43.463444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 695/1417] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:43.467660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.469847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.472932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:33:43.473074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments (ip 10.222.0.78) !!! Sep 19 11:33:43.480477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.480962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.481404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.482101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.482611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.483013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.514020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f84c8106-67ba-433e-acc2-5f1363d37ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050333 Sep 19 11:33:43.514631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 723/1418] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:43.538147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:43.538783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:43.545485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.545914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.546352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.547054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:43.547666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:43.547969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:43.681741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:43.691675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-39478c32-309f-4e1b-96a4-08ced03577f2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157719 Sep 19 11:33:43.692291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 696/1419] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:44.055437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:44.057681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:44.065839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.066332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.066777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.067513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.067991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.068400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.102836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-47fcc182-d87f-4078-a77d-e92a58914ff3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052002 Sep 19 11:33:44.103456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 724/1420] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:44.475539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:44.477641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:44.484023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.484502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.484934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.485615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.486061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.486477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.516112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2bbc1084-7b37-4298-9370-7658fe0d7214 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044633 Sep 19 11:33:44.516668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 697/1421] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:44.526377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:44.528636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:44.534546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.535023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.535494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.536182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.536637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.537068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.566085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-841a510c-8af9-4151-be65-3e4bdc8c54d6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043023 Sep 19 11:33:44.566675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 725/1422] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:44.717910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:44.718524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:44.725034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.725518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.726008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.726650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:44.727105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:44.727629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:44.858319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:44.866778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-10659a93-1bc0-4608-ab15-d0b588b8eac6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152740 Sep 19 11:33:44.867390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 698/1423] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:45.116368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:45.118596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:45.125113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.125594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.126061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.126749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.127224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.127650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.156943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-63d38dd2-f2c9-46c5-8789-fd1664bdd22b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045226 Sep 19 11:33:45.157517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 726/1424] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:45.528549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:45.530749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:45.537700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.538180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.538616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.539341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.539788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.540207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.569427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6eeba303-e470-47d7-b4eb-2802a316c57c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044835 Sep 19 11:33:45.569974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 699/1425] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:45.578194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:45.580366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:45.586349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.586831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.587300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.587986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.588439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.588857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.617986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bdf42824-ca88-43bd-b2c2-8ab931f41189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043999 Sep 19 11:33:45.618543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 727/1426] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:45.890447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:45.891036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:45.897565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.898051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.898497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:45.899241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:45.899701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:45.900128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.032222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:46.040622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9c93adfd-c131-4fad-9854-ec4cb7490fda tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154274 Sep 19 11:33:46.041198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 700/1427] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:46.169871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:46.171955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:46.178373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.178848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.179326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.180021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.180478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.180904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.211011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-78b1b4ce-d2af-4db6-8d0e-a8c4633acb9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045232 Sep 19 11:33:46.211616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 728/1428] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:46.582635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:46.584985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:46.587102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:33:46.587274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:33:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments (ip 10.222.0.78) !!! Sep 19 11:33:46.596592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.597078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.597562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.598269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.598749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.599203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.630616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:46.631318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bb5d9702-2c82-4b08-bbb7-3ac5a698f846 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052482 Sep 19 11:33:46.631606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 701/1429] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:46.632878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:46.639091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.648721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.648721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.648721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:46.648721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:46.649116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:46.671113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b44ee3e1-35e4-4540-9ea9-1cfadbc8ec14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045050 Sep 19 11:33:46.675632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 729/1430] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:47.063626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:47.064246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:47.071314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.071804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.072242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.073344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.073801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.074265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.207254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:47.214948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-27431ce2-5bec-4bd1-9225-bf5364ca4787 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155199 Sep 19 11:33:47.215542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 702/1431] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:47.224159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:47.226348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:47.232729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.233207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.233644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.234337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.234788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.235238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.264767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-56509aa1-1075-452a-a4c9-94d2704d532e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045168 Sep 19 11:33:47.265313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 730/1432] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:47.644898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:47.654694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:47.654694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.654694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.654694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.655196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.655652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.656074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.684414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:47.686356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9436a007-27b1-4bfa-a651-42b3efb6ad4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045437 Sep 19 11:33:47.686762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:47.686997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 703/1433] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:47.693598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.694082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.694524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.695262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:47.695757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:47.696193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:47.725195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8e082804-45cf-4b16-a543-505cd75b3b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044671 Sep 19 11:33:47.725757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 731/1434] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:48.238697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:48.239874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:48.245878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.246413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.246803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.247517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.247975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.248401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.277734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:48.280028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:48.286653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.287136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.287606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.288293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.288741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.289160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.319777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4d1f173e-fe93-432c-bf77-e18ca1e11e26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045974 Sep 19 11:33:48.320340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 732/1435] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:48.380458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:48.388314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6e4240fd-97b9-498e-925e-c3ee3247cacb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153555 Sep 19 11:33:48.388873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 704/1436] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:48 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:48.699569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:48.701966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:48.707925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.708413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.708852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.709547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.709999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.710428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.737817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:48.740206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-337ba195-92af-44fb-ade4-80008ce5a203 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Sep 19 11:33:48.740673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:48.740803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 733/1437] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:48.746998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.747504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.747932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.748616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:48.749062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:48.749482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:48.777580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3d233df3-433d-4cb3-a66e-f146652a93f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043710 Sep 19 11:33:48.778117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 705/1438] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:49.332708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:49.334868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:49.341218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.341690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.342121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.342796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.343270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.343690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.370263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:49.374827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9ebcd3c-f574-4032-8a01-2731cbf63e48 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046157 Sep 19 11:33:49.375400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 734/1439] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:49.410803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:49.411456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:49.417598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.418081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.418517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.419237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.419695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.420189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.550229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:49.558627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30323e3b-34a9-4340-ae13-1c4a53099505 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151644 Sep 19 11:33:49.559242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 706/1440] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:49.753275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:49.755502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:49.761477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.761959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.762407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.763099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.763586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.764013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.790724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:49.792925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:49.794132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-14edf089-d49c-48cc-992d-dec3f84961cd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045313 Sep 19 11:33:49.794712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 735/1441] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:49.799415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.799894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.807120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.807120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:49.807120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:49.807120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:49.831721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c6209498-013d-4310-b985-2f571384d223 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044908 Sep 19 11:33:49.832274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 707/1442] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:50.392359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:50.394655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:50.402270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.402794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.403331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.404094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.404554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.404983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.439813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0995548a-9d1f-4c40-b074-da453c8b311a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051267 Sep 19 11:33:50.440577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 736/1443] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:50.582070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:50.582687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:50.588744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.589225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.589659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.590348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.590804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.591253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.728146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:50.735769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1a0456da-000b-489e-8bfd-52de880782a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157621 Sep 19 11:33:50.736332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 708/1444] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:50.817546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:50.819707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:50.826124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.826859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.827317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.828006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.828444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.828864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.844645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:50.846799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:50.853710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.854193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.854628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.855367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:50.855819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:50.856247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:50.858631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6a7d0ece-bbb6-444d-bee4-db7a764bee67 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044980 Sep 19 11:33:50.859215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 737/1445] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:50.885739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2f9802ea-1671-4389-946e-813223ce73d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044978 Sep 19 11:33:50.886300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 709/1446] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:51.454726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:51.457022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:51.464337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.464826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.465266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.466044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.466422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.466850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.497598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b7d77287-8db8-4ab5-9ddb-05c7e58168fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047269 Sep 19 11:33:51.498161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 738/1447] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:33:51.759667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:51.760274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:51.766231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.766716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.767144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.767859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.768308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.768736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.871738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:51.873949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:51.880374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.880876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.881322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.882023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.882476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.882922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.902054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:51.910272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-75dd8b96-d727-470b-9fe4-308b38b03fab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154601 Sep 19 11:33:51.911081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 710/1448] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:51.915460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-37c26318-3bda-4557-b714-d6ebb44ac150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048126 Sep 19 11:33:51.919953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 739/1449] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:51.928278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:51.928278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:51.934159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.934647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.935082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.935816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:51.936270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:51.936685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:51.966547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-88be320b-17a9-40d0-8a8a-22075557ef2c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045221 Sep 19 11:33:51.967118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 711/1450] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:52.510754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:52.512971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:52.519421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.519906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.520347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.521031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.521485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.521914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.551589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eb0fa771-39b4-4ad5-ab9a-bc831c4a160d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045599 Sep 19 11:33:52.552145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 740/1451] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:52.930942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:52.933056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:52.937741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:52.938379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:52.939708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.940188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.940619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.941312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.941756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.942170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.944368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.944918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.945987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.946602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:52.946735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.947150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.947635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.972715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5fade2c0-8a8f-43c0-b61c-0ae2392bf379 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046247 Sep 19 11:33:52.973549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 712/1452] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:52.978820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:52.981028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:52.987892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.988376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.988808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:52.989534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:52.989985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:52.990407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.022757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ad5aec9e-fd79-478c-b4af-3c5119ca378f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047679 Sep 19 11:33:53.023595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 713/1453] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:53.084113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:53.091986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-84ecaa70-b890-43d2-8558-e4efbc395ab5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158072 Sep 19 11:33:53.092564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 741/1454] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:53.564486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:53.566646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:53.572636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.573118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.573552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.574246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.574698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.575125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.605604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-45c788e1-bc51-4ba6-9165-82beeb072152 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045053 Sep 19 11:33:53.606175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 714/1455] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:53.985434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:53.987567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:53.994025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.994516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.994954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:53.995682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:53.996140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:53.996569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.033813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb41b5b9-a03d-4bf9-84ec-759e9e57a049 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052417 Sep 19 11:33:54.034390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 742/1456] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:54.034794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:54.037135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:54.043756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.044238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.044670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.045365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.045818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.046252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.075690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc4e6ea6-c503-4384-8582-ed402d6b7448 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Sep 19 11:33:54.076242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 715/1457] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:54.116190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:54.117267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:54.122853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.123448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.123892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.124585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.125038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.125459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.255824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:54.263611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fedb11b3-32d3-47f9-b2b4-29226eca7dff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151449 Sep 19 11:33:54.264183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 743/1458] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:54.618287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:54.620417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:54.626368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.626849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.627361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.628047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:54.628496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:54.628918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:54.658984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f78b8403-b7c0-4efc-b8ad-d25280a7b5af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044775 Sep 19 11:33:54.659607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 716/1459] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:55.046208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:55.048409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:55.055300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.055787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.056228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.056929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.057384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.057821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.087868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0882e2d8-c843-43ac-8a82-b9f8bb2f36ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045598 Sep 19 11:33:55.088440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 744/1460] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:55.088573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:55.090899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:55.097295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.097774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.098208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.098895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.099414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.099840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.130016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5d73d382-7369-4bd0-b059-74e519235997 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045319 Sep 19 11:33:55.130516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 717/1461] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:55.287463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:55.288073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:55.294201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.294677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.295112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.295826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.296332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.296709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.431302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:55.439093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bea8c25d-e20b-4440-828a-4161328a8ece tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155537 Sep 19 11:33:55.439696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 745/1462] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:33:55.672067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:55.674322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:55.681056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.681539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.681984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.682707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:55.683187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:55.683626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:55.713382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c669b34c-ad22-4a54-9ff9-03d5f615e1c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045469 Sep 19 11:33:55.713934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 718/1463] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:56.100847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.103569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.110240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.110736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.111194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.111911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.112369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.112802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.142879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.144413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4d1df13f-c8e7-4cba-8835-afeb0e69da8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047628 Sep 19 11:33:56.144989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 746/1464] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:56.145285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.151537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.152027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.152465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.153153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.153606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.154028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.183872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3488a3ab-c11d-4d02-84f8-fc512ddb1d44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044892 Sep 19 11:33:56.184446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 719/1465] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:56.465157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.465755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.471691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.472234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.472742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.473470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.473935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.474410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.609898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:56.617753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6ecb937b-97f2-44bf-97d6-c16af01bc1c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156640 Sep 19 11:33:56.618316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 747/1466] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:56.726078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:56.728934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:56.735495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.736094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.736517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.737225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:56.737682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:56.738109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:56.769181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-02095f7a-a4be-465f-b3ff-6a96b1492e50 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047375 Sep 19 11:33:56.769739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 720/1467] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:57.156944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:57.159187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:57.165654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.166132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.166569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.167291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.167745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.168175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.196927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:57.197821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f64d53db-4b4b-47d3-94cf-94a2d9b3abe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Sep 19 11:33:57.198391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 748/1468] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:57.199096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:57.205883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.206373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.206812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.207531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.207990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.208416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.237597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b47c794b-cb64-45fb-98c6-84dd5add40d7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045099 Sep 19 11:33:57.238167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 721/1469] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:57.640916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:57.641524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:57.647708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.648222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.648661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.649353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.649800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.650223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.781133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:57.782652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:57.784928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:57.788998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-01c3f6fe-f733-439a-94f3-f6d77f5901d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152044 Sep 19 11:33:57.789569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 749/1470] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:57.791018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.791603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.792053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.792757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:57.793208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:57.793634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:57.823518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ecd9d2c7-8292-49d9-84d6-f13a3150d069 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Sep 19 11:33:57.824075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 722/1471] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:33:58.210593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:58.212946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:58.219382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.219859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.220294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.220978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.221423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.221847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.250074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:58.251534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-59bdfde9-a437-42a4-8d90-6ade146835de tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044838 Sep 19 11:33:58.252098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 750/1472] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:58.252265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:58.259819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.260310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.260750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.261445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.261904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.262331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.291190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e61d633f-1852-4964-a6c6-b5bdb3ccda81 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044948 Sep 19 11:33:58.291681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 723/1473] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:58.812694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:58.813301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:58.820075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.820562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.820998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.821688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.822143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.822568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.836756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:58.838940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:58.844079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:58.844932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.845434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.845868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.846568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:58.847022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:58.847469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:58.879519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8bf2070f-07d8-4b13-a28b-a6e6ab0701d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047128 Sep 19 11:33:58.880301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 724/1474] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:33:58.962029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:33:58.969988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a0074b44-a177-44f0-8a0e-b8e60e738c11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.161542 Sep 19 11:33:58.970555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 751/1475] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:33:59.264232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:59.266454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:59.268860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:33:59.273822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.276591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.276591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.276591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.276591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.277009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.303144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:59.306029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:59.309278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6313477d-409a-43fc-842e-166ef219762e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048965 Sep 19 11:33:59.309859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 725/1476] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:33:59.312777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.313263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.313700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.314399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.314850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.315531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.346626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9c75793-bd9b-4a08-b04e-03f2afbcaba1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047551 Sep 19 11:33:59.347216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 752/1477] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:33:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:33:59.892786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:59.894947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:33:59.902111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.902594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.903032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.903766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:33:59.904217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:33:59.904640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:33:59.935435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-17b2a4f5-5c3e-4737-b5ca-00a5136d06e1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046667 Sep 19 11:33:59.936016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 726/1478] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:33:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:33:59.993870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:33:59.994587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:00.001025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.001516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.001953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.002683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.003136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.003593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.214394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:00.222716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-76150ff9-430b-4120-85f2-60e716011877 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.233308 Sep 19 11:34:00.227637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 753/1479] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:33:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:00.322641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:00.324892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:00.331572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.332053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.332558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.333256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.333704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.334125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.358982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:00.361239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:00.364533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff80cb35-1b00-42c0-af11-a239cb6db7fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046352 Sep 19 11:34:00.365491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 727/1480] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:00.368988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.369482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.369984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.370684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.371134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.371676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.402034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-72b2787e-b5c5-4cc4-9269-d82bd8504b49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047045 Sep 19 11:34:00.402612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 754/1481] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:00.948149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:00.951007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:00.957440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.957935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.958379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.959097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:00.959585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:00.960015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:00.985213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:00.991001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0eff399d-9a1a-4781-9a44-b4071f8bdce2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046922 Sep 19 11:34:00.991607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 728/1482] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:01.245366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:01.245897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:01.252357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.252843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.253280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.253973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.254462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.254891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.377650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:01.379842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:01.386905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.387707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.387962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.388664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.389098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:01.389537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.389537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.397565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-77666ea6-8824-4652-9e14-c88a4b2b9968 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156729 Sep 19 11:34:01.398160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 755/1483] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:01.414444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:01.417506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:01.421232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7193dac8-2582-495e-953a-62a7970b14cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047535 Sep 19 11:34:01.421832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 729/1484] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:01.423535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.424025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.424461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.425163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:01.425618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:01.426043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:01.455257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a9bf642d-f769-40a4-b298-2ac9d3f214d1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044746 Sep 19 11:34:01.455811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 756/1485] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:02.004098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:02.006246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:02.012849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.013328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.013765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.014461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.014911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.015369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.045745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f8256ef3-8673-4df9-8dcc-2db2082b451c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045686 Sep 19 11:34:02.046312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 730/1486] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:02.421967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:02.422614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:02.429187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.429669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.430113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.430815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.431301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.431735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.433715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:02.435907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:02.442386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.442870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.443347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.444037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.444491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.445041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.478329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23604dfb-1372-4cdc-a0b1-3a646fabed3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048457 Sep 19 11:34:02.478912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 731/1487] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:02.483494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:02.485615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:02.491448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.491924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.492355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.493088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:02.493537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:02.493954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:02.523309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0c10928d-894e-4329-811a-9f8aaefdf7b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043291 Sep 19 11:34:02.523916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 732/1488] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:02.562933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:02.571266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-294d6d4f-b2bb-435c-bab9-b6b8bac1a9cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152690 Sep 19 11:34:02.571842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 757/1489] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:03.058865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:03.060975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:03.067013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.067544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.067985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.068686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.069148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.069577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.100509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-99fbdaf5-177e-4b82-970f-deb32f3d1d22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046320 Sep 19 11:34:03.101079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 733/1490] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:03.491517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:03.493760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:03.499992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.500555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.501068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.501954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.502477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.503000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.535594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7da2148e-9b3f-4155-93ef-1fa7aa9b8447 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048055 Sep 19 11:34:03.535865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:03.536355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 758/1491] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:03.538039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:03.545228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.545746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.546185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.546890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.547719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.548488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.580638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1757cf57-b11b-4151-bf70-0af564245b89 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048617 Sep 19 11:34:03.581222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 734/1492] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:03.595901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:03.596429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:03.602398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.602880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.603355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.604048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:03.604503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:03.604928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:03.741597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:03.750327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a11cb739-1bd3-4f22-b97b-66524fbefb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158282 Sep 19 11:34:03.751011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 759/1493] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:04.117334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:04.121069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:04.130873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.131391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.131824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.132534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.132969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.133891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.163391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b97f6943-71d1-4c98-b171-159545038741 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053692 Sep 19 11:34:04.163944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 735/1494] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:04.548187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:04.550381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:04.556365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.556855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.557295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.557991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.558449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.558883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.589190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7d61159c-9d49-4e29-9744-4ebbd8a6cb59 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045098 Sep 19 11:34:04.589753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 760/1495] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:04.593933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:04.596122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:04.602605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.603341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.604085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.604792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.605247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.605679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.635614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ad9ed64a-3bac-4d73-95a2-577ec7295c21 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045706 Sep 19 11:34:04.636172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 736/1496] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:04.773643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:04.775238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:04.781187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.781673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.782116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.782801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:04.783285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:04.783715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:04.918594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:04.926406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ef0abb67-5643-4d0d-bcf6-4b4b2a8aa6c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156606 Sep 19 11:34:04.926981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 761/1497] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:05.176169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:05.178327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:05.184796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.185270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.185707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.186390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.186834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.187282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.215942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0c805f41-7d4f-4fa6-bd92-600d51768ef2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043893 Sep 19 11:34:05.216492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 737/1498] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:05.601640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:05.604430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:05.610873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.611401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.611846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.612539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.612995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.613422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.642629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5c8423a2-b81f-4753-8b9d-61bae36060d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044942 Sep 19 11:34:05.643211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 762/1499] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:05.648442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:05.651131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:05.658333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.658823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.659300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.660010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.660463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.660890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.690005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-933f0baa-ec4f-4c7c-b755-816562f65852 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045605 Sep 19 11:34:05.690568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 738/1500] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:05.950874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:05.951730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:05.958918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.959434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.959872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:05.960572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:05.961059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:05.961449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:06.096570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:06.104352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d2fee756-16bf-4f9d-9cd0-93235007adc1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157989 Sep 19 11:34:06.104911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 763/1501] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:06.228814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:06.230873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:06.236832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:06.237307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:06.237738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:06.238414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:06.238861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:06.239320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:06.269095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-91e631a3-9b99-4159-a726-2b47b91730d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044292 Sep 19 11:34:06.269643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 739/1502] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:06.655473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:06.657640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:06.665182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:06.665655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:06.666137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:06.667381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:06.667827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:06.668246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:06.699202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cc9809ce-4f8f-42cf-9a7b-9d376184b23f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047877 Sep 19 11:34:06.699792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 764/1503] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:06.702666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:06.704987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:06.711522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:06.712009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:06.712453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:06.713151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:06.713616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:06.714067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:06.744581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-90f0ff92-4c07-4200-97a4-f8e95a224c30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046293 Sep 19 11:34:06.745635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 740/1504] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:07.126784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:07.127444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:07.133350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.133836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.134278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.135063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.135458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.135889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.268874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:07.277342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-32f05053-3bcb-4c01-a631-ad60221a6a2a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154435 Sep 19 11:34:07.277923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 765/1505] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:07.282230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:07.284427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:07.290376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.290862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.291335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.292579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.293032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.293460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.322308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f1b0a754-1037-438f-8d43-9af15d27d8dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Sep 19 11:34:07.322859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 741/1506] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:07.711440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:07.713695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:07.720737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.721220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.721655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.722349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.722802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.723248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.754165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7b4a3cce-f53d-4b26-b64c-a741d0139200 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046696 Sep 19 11:34:07.754743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 766/1507] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:07.758321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:07.760548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:07.767814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.768313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.768760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.769476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:07.769989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:07.770500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:07.800396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c73d8997-bc92-4a11-a802-f90d8db430fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046486 Sep 19 11:34:07.800980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 742/1508] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:08.300995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:08.301607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:08.308218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.308703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.309140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.309830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.310287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.310716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.336191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:08.338383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:08.344477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.344964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.345403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.346105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.346559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.346986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.377836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-badf3797-c7c9-4c73-bf64-5f07d43488f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045459 Sep 19 11:34:08.378307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 743/1509] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:08.444639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:08.453148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-39d734ba-4d28-4747-9e58-6a027d1cf2a0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155427 Sep 19 11:34:08.453148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 767/1510] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:08.766839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:08.769075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:08.775443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.775955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.776903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.777594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.778048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.778473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.807830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fe510657-4ceb-4db6-ae5d-cf0649050a3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044988 Sep 19 11:34:08.808390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 744/1511] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:08.812758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:08.814912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:08.820975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.821534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.821972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.822665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:08.823656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:08.824087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:08.828042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:08.854042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3886093e-27ec-475a-9f14-44af454fa9d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Sep 19 11:34:08.854658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 768/1512] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:09.391365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:09.393508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:09.399642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.400118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.400549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.401245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.401694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.402117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.418873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:09.431880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9607181a-4275-477c-ab7e-29ecf63d2f51 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045521 Sep 19 11:34:09.432438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 745/1513] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:09.476522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:09.477131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:09.483378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.483866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.484307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.485004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.485468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.485888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.618035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:09.626620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-51d1ad68-49cc-498e-b16e-930d2e7e32c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154370 Sep 19 11:34:09.627235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 769/1514] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:09.820391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:09.822938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:09.829497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.829977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.830419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.831113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.831615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.832044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.861657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ec16a736-6ab5-4852-957c-0ff6b15927ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045223 Sep 19 11:34:09.862218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 746/1515] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:09.866234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:09.868416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:09.871373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:09.877333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.879358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.879358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.879358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:09.879358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:09.879771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:09.915148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-425c2382-caee-4ae9-a87d-54098a998898 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052867 Sep 19 11:34:09.915726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 770/1516] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:10.445222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:10.447419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:10.454607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.455091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.455581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.456276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.456731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.457156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.486482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f84131f9-37c7-4407-a260-d65784d31cc8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045355 Sep 19 11:34:10.487044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 747/1517] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:10.649697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:10.650311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:10.657145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.657628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.658068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.658757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.659243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.659674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.790019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:10.797811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-04e2e428-d9e8-4bca-a382-4542682e1157 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152007 Sep 19 11:34:10.798381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 771/1518] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:10.874741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:10.876905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:10.882897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.883411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.883846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.884525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.884973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.885390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.916322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3d9d262b-23e0-483a-bf56-7f7b8279e015 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046093 Sep 19 11:34:10.916878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 748/1519] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:10.928122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:10.930400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:10.938478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.938960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.939424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.940116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:10.940566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:10.940988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:10.971557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d7570264-c675-44e1-ba84-62d804ecf2ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047278 Sep 19 11:34:10.972071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 772/1520] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:11.498613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:11.500839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:11.507407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.507898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.508341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:11.509081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.509550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.509975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:11.540119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-48c64909-67c1-4324-910d-42b481042179 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045613 Sep 19 11:34:11.540692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 749/1521] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:11.821825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:11.822427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:11.829697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.830180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.830609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:11.831390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.831839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.832258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:11.929077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:11.931342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:11.937299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.937779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.938214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:11.938901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.939378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.939799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:11.967051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:11.973220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5e508ab2-1919-4b19-9c52-0d2e1803d154 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047896 Sep 19 11:34:11.974332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 750/1522] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:11.975962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d20a0cde-09b1-4598-9766-3919eeb38518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157932 Sep 19 11:34:11.976542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 773/1523] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:11.984117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:11.986300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:11.992402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.992889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.993329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:11.994026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:11.994484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:11.995731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:12.025603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07ec6bb2-aaa5-4230-8c25-bdc0730b18c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045623 Sep 19 11:34:12.028634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 751/1524] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:12.553311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:12.555458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:12.561790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:12.562263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:12.562688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:12.563401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:12.563847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:12.564263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:12.593717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f7f61a41-136e-41eb-a660-94a9b4d685f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Sep 19 11:34:12.594259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 774/1525] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:12.986618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:12.988819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:12.995253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:12.995742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:12.996256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:12.996954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:12.997412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:12.997845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:13.004413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:13.005022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:13.011235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:13.011725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:13.012168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:13.012867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:13.013322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:13.013749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:13.028254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8974abc3-89e9-4b98-a474-4e0a30b87658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045619 Sep 19 11:34:13.028836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 752/1526] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:13.037950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:13.040145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:13.046679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:13.047163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:13.047633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:13.048325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:13.048775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:13.049199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:13.078943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-83d0f4ac-44e1-467b-834b-cff5f6152f76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Sep 19 11:34:13.079539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 753/1527] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:13.147239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:13.155483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a27dc9f7-c3fd-45cc-b4cc-fb632b35be08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154867 Sep 19 11:34:13.156132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 775/1528] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:13.606707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:13.608894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:13.614867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:13.615400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:13.615840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:13.616581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:13.617038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:13.617793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:13.651460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f42629fa-6181-47be-a272-1552069a231b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048671 Sep 19 11:34:13.652227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 754/1529] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:14.041140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:14.043312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:14.049747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.050227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.050664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.051395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.051849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.052274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.083093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6d28d5b1-3792-41af-8085-3e2e2d866da4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045904 Sep 19 11:34:14.083682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 776/1530] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:14.091252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:14.093418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:14.099879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.100363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.100802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.101497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.101950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.102374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.141067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-188689c9-5bc1-424d-851e-c0f62bc4d3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053791 Sep 19 11:34:14.141635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 755/1531] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:14.179363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:14.179973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:14.186535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.187022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.187486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.188207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.188662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.189091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.324191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:14.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-95d0333d-6bcc-4768-acca-b011f3f5b715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156995 Sep 19 11:34:14.332846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 777/1532] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:14.665501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:14.668680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:14.675221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.675710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.676147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.676841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:14.677290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:14.677712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:14.707211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1473cfab-6442-4e61-a5b8-9ed6786f7049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045928 Sep 19 11:34:14.707770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 756/1533] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:15.097503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:15.099698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:15.106304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.106791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.107256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.107954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.108406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.108831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.139033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e56aac41-e717-40c6-9745-4a3978bd5b41 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Sep 19 11:34:15.139626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 778/1534] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:15.154499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:15.156689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:15.163093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.163609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.164053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.164746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.165202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.165629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.194584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-53eac642-b01c-4a8a-820b-b08351cd945c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045048 Sep 19 11:34:15.195135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 757/1535] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:15.355542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:15.356094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:15.362779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.363305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.363745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.364440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.364902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.365331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.498021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:15.505872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1cb096bc-bc70-4524-ac99-38339eac56d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154342 Sep 19 11:34:15.506437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 779/1536] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:15.719937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:15.722011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:15.728016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.728503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.728944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.729633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:15.730590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:15.731017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:15.760893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bd229277-f576-43f9-a3f2-a4a43a148515 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045002 Sep 19 11:34:15.761466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 758/1537] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:16.152525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:16.154717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:16.161677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.162154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.162589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.163321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.163807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.164306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.194509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4c74e084-19f3-4865-8a3e-137b70f23afc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046952 Sep 19 11:34:16.195060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 780/1538] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:16.207604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:16.209796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:16.216679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.217195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.217638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.218326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.218780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.219225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.248675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-015b3822-2adc-4ac6-8f1a-f67880bfb9b3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Sep 19 11:34:16.249237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 759/1539] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:16.530388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:16.531001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:16.537163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.537649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.538087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.538788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.539278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.539707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.671094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:16.679642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-82e837f5-78d1-4588-a54c-9dd259bb45f3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153678 Sep 19 11:34:16.680333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 781/1540] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:16.773667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:16.775870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:16.782033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.782443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.782870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.783583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:16.784032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:16.784455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:16.814075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5ee1d79a-2312-403e-82ce-19b3850c5995 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Sep 19 11:34:16.814624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 760/1541] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:17.207049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:17.209224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:17.215621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.216123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.216566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.217256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.217709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.218135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.248158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-50b43780-d29e-46c5-8bdd-656c16a864ca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045109 Sep 19 11:34:17.248717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 782/1542] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:17.260859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:17.262996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:17.269341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.269816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.270241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.270915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.271403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.271832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.300436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fce6ea90-f17c-4cd7-b30a-99702280bbc3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 Sep 19 11:34:17.300980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 761/1543] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:17.704478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:17.705087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:17.711006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.711522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.711960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.712647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.713101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.713524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.827159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:17.829386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:17.835544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.836025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.836456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.837139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:17.837586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:17.838002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:17.842250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:17.848346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:17.856360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-070e5ade-3272-48ad-b75a-99097ba61f49 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155994 Sep 19 11:34:17.856939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 783/1544] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:17.869095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b567677e-91b0-4bee-99d7-e6eae0bb0178 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046763 Sep 19 11:34:17.869653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 762/1545] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:18.261529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:18.263820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:18.270228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.270713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.271155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.271875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.272332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.272764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.298225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:18.303345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b37973e1-14fd-4bae-8032-9660846f57c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Sep 19 11:34:18.304120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 784/1546] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:18.313659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:18.316527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:18.322891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.323474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.324423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.325125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.325800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.326224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.355803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b51fe2c2-3b58-43fe-84c4-9a854502478b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046156 Sep 19 11:34:18.356370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 763/1547] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:18.879798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:18.880861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:18.881704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:18.884072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:18.886967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.887470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.887899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.888585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.889032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.889729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.890686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.891162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.891624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.892325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:18.892783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:18.893216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:18.923217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c212fbf2-ff88-4b1b-bb3c-484f04f2f094 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045696 Sep 19 11:34:18.923778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 764/1548] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:19.027106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:19.034903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d673dd9a-b6af-45d1-8ea8-16ed38fe1866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158962 Sep 19 11:34:19.035508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 785/1549] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:19.316592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:19.318744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:19.325854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:19.326331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:19.326755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:19.327461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:19.327908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:19.328327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:19.357610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-72677da5-c5c2-4b69-b870-ae8f0a2874b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Sep 19 11:34:19.358177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 765/1550] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:19.367608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:19.369975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:19.376570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:19.377057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:19.377495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:19.378193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:19.378650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:19.379077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:19.410017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a2f731df-a3a8-411e-a51f-5da209503252 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046482 Sep 19 11:34:19.410501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 786/1551] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:19.936302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:19.938436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:19.944406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:19.944883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:19.945312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:19.945997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:19.946444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:19.946860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:19.976631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a17fb305-1b9e-4cc4-8f32-ed5e1bda90ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044815 Sep 19 11:34:19.977188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 766/1552] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:20.057874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:20.059047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:20.065090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.065558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:20.065986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:20.066669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.067115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:20.067563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:20.203032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:20.210778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b559dea1-da57-466f-a498-9476b26921fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156798 Sep 19 11:34:20.211375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 787/1553] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:20.370743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:20.373585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:20.380178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.380658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:20.381104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:20.381801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.382255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:20.382685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:20.412818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-80aca82d-0ce7-4df5-a58f-d3b09d046565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045993 Sep 19 11:34:20.413391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 767/1554] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:20.422440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:20.424735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:20.431280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.431767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:20.432197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:20.432895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.433935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:20.434360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:20.463420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b5a191ab-dd3b-43f7-bab5-201ff0d2e008 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045333 Sep 19 11:34:20.463911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 788/1555] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:20.989228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:20.991541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:20.997830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.998319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:20.998763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:20.999498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:20.999993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:21.000418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:21.030800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-36a1723b-3423-4d8d-bc8c-bc5687e0f556 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045542 Sep 19 11:34:21.031388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 768/1556] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:21.234569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:21.235202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:21.241270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:21.241694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:21.242131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:21.242846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:21.243331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:21.243760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:21.372312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:21.380125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b6ef1e12-d879-471c-9ed6-49c2dc4a14ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150021 Sep 19 11:34:21.380679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 789/1557] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:21.426177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:21.428437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:21.435475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:21.435962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:21.436403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:21.437093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:21.437549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:21.437977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:21.467658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e3f5e0d6-1050-4f55-a864-0ac594db55ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045496 Sep 19 11:34:21.468216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 769/1558] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:21.476737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:21.478999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:21.485401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:21.485882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:21.486317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:21.487009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:21.487489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:21.487916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:21.518073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-89c964b9-40bb-4310-9781-e35173413e80 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045404 Sep 19 11:34:21.518628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 790/1559] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:22.043537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:22.045751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:22.051723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.052205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.052646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.053338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.053790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.054213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.084267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9055d5d7-3dc8-486e-8d66-0e58326c94bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044870 Sep 19 11:34:22.084934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 770/1560] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:22.403137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:22.403701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:22.409671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.410155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.410590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.411314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.411771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.412202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.479191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:22.481958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:22.488713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.488848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.489199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.489901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.490353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.490771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.521785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0ac669f5-d638-4084-ac76-be1e49fc3cf4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046552 Sep 19 11:34:22.522621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 771/1561] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:22.529929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:22.532224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:22.538726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.538726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.538955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.539792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:22.540243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:22.540664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:22.546480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:22.554385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-317251aa-d040-4075-86ab-cbfc6ffba918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155344 Sep 19 11:34:22.554954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 791/1562] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:22.571616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-80370daa-87a1-41f1-ba96-397c98f02174 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045497 Sep 19 11:34:22.572175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 772/1563] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:23.097151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:23.099361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:23.105312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.105818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.106258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.106955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.107440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.107871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.138695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ffbf2be6-2e68-482f-a662-8b778d227f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045512 Sep 19 11:34:23.139279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 792/1564] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:23.534331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:23.536508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:23.542926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.543456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.543893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.544583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.545042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.545469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.576418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b702c2a-ccb1-4804-b26c-90dd5bcdcf54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046042 Sep 19 11:34:23.576993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 773/1565] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:23.578690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:23.579493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:23.584471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:23.586133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.586609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.586730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:23.587035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.587745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.588203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.588614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.592545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.593031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.593471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.594168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:23.594772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:23.595216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:23.625612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cbc3e7b3-e14b-4a53-aff5-dd4d68bcea52 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045022 Sep 19 11:34:23.626195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 774/1566] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:23.720689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:23.728421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-860f0dfc-e0cd-4e7e-846c-d94c4fa4338a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154463 Sep 19 11:34:23.733440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 793/1567] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:24.150993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:24.153843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:24.155740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:24.160540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.167110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.167110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.167110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.167110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.167540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.193025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4eb324f7-b20e-46b9-a35a-ed59224b0259 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046014 Sep 19 11:34:24.193576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 775/1568] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:24.589283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:24.591472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:24.597946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.598427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.598865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.599586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.600042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.600478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.631034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9395fb5a-f50d-41b3-b581-44b4d85d2d72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Sep 19 11:34:24.631639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 794/1569] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:24.638511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:24.640706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:24.647016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.647570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.647998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.648676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.649125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.649545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.678621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b99e93f8-269c-4212-9cbe-cdf6e099755a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Sep 19 11:34:24.679191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 776/1570] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:24.751300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:24.751909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:24.757832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.758314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.758756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.759467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:24.759927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:24.760355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:24.890024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:24.897812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-37ce9ca2-5b43-4cd1-8584-a0426d1ca046 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150421 Sep 19 11:34:24.898378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 795/1571] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:25.206518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:25.208719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:25.214734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.215258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.215700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:25.216393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.217012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.217282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:25.247020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5170aa4d-efc4-4209-85a2-5459d9586e10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044456 Sep 19 11:34:25.247611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 777/1572] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:25.643102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:25.645310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:25.651817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.652298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.652733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:25.653423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.653885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.654313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:25.684523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-920e8bf6-d32f-4343-9032-79566cb79ee6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045336 Sep 19 11:34:25.685087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 796/1573] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:25.690760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:25.692954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:25.699708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.700192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.700899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:25.701590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.702046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.702473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:25.727430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:25.732809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b02b5ed2-707c-4f44-9221-f14733d7ad5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045922 Sep 19 11:34:25.733379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 778/1574] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:25.921592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:25.922130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:25.928108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.928596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.929040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:25.929727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:25.930189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:25.930621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:26.062866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:26.070649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-34727bc1-6ce5-4409-8883-76d8017b8669 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153485 Sep 19 11:34:26.071232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 797/1575] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:26.259839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:26.262027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:26.268417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:26.268904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:26.269348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:26.270037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:26.270495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:26.270922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:26.300290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dfc85424-9b17-4573-a468-3e88143cfe1f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044445 Sep 19 11:34:26.300855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 779/1576] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:26.697682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:26.699845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:26.706811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:26.707338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:26.707782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:26.708484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:26.708939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:26.709360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:26.745055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:26.747607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:26.748022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-393bc693-49f6-454e-8af6-75c3822f14cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054585 Sep 19 11:34:26.748752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 798/1577] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:26.754462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:26.754950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:26.755421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:26.756164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:26.756619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:26.757048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:26.788312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-78ba63bb-de93-4f26-b9d1-105b8f8369f4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047183 Sep 19 11:34:26.788884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 780/1578] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:27.094813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:27.095462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:27.101349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.101820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.102247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.102926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.103408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.103830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.234407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:27.242389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0caf0f7d-dd73-428a-b0f7-3370f9b16c4b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151991 Sep 19 11:34:27.242949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 799/1579] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:27.313399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:27.315569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:27.321782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.322261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.322697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.323418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.323872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.324295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.354221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7822d9f4-c1bf-4e30-b19f-56ea6b60f1ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045291 Sep 19 11:34:27.354802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 781/1580] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:27.761268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:27.763465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:27.769849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.770329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.770761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.771485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.771937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.772361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.801885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:27.802448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-650a71f7-2385-4d19-af85-83ea72cbdf7a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 19 11:34:27.803257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 800/1581] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:27.804202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:27.811381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.811866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.812309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.813038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:27.813492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:27.813917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:27.843035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dfeedb46-37e4-4b6b-8acf-ee12e20dfb17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045155 Sep 19 11:34:27.843644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 782/1582] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:28.266106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:28.266737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:28.272721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.273196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.273628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.274305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.274750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.275193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.294200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:28.366147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:28.368430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:28.374301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.374775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.375269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.375971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.376419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.376843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.408146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-80860158-6014-46f3-a9bf-1db70d61a22f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046004 Sep 19 11:34:28.408936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 783/1583] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:28.410221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:28.418369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf771e0f-f47f-4537-a99b-2af8465acfea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156075 Sep 19 11:34:28.418950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 801/1584] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:28.814816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:28.817009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:28.823709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.824199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.825220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.826171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.826624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.827047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.855768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:28.857514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-20c4d1e7-8b57-4069-ae51-0604258635ce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046623 Sep 19 11:34:28.857946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:28.862140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 784/1585] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:28.864701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.865178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.865614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.866302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:28.866745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:28.867213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:28.896590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-faa33cd0-dabd-4353-a68e-990dbbbbdeca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044945 Sep 19 11:34:28.897140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 802/1586] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:29.420985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:29.423107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:29.429130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.429608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.430039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.430727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.431193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.431681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.441022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:29.441633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:29.447650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.448132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.448649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.449351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.449808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.450487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.461546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8394e5ac-d1c7-46dd-82b6-fc3059b1b01e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045172 Sep 19 11:34:29.462127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 785/1587] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:29.585400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:29.593141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c84a0e11-0a94-4a39-985f-6f4a1e49eebe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155967 Sep 19 11:34:29.595243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 803/1588] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:29.869572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:29.872418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:29.878816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.879418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.879857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.880558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.881012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.881442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.909193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:29.910888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7ba68800-bbeb-4623-9931-39816b8f8f33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045301 Sep 19 11:34:29.911476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:29.911643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 786/1589] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:29.918021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.918992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.919452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.920205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:29.920658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:29.921087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:29.950765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9ec403d1-06b1-4db0-935f-8fcd5d9fa3e2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045304 Sep 19 11:34:29.951346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 804/1590] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:30.474371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:30.476603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:30.483372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.483859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.486384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:30.486384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.486384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.486384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:30.515337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1cc359f8-e88c-4b0d-ade7-753a208b77a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044941 Sep 19 11:34:30.515911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 787/1591] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:30.616765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:30.617376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:30.623410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.623894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.624334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:30.625023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.625488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.625918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:30.753615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:30.761465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-711a4259-aa2f-43d9-b5af-d724cd49b1f0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.148663 Sep 19 11:34:30.762541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 805/1592] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:30.924193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:30.926499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:30.932881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.933364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.933796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:30.934486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.934931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.935504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:30.963548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:30.966434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:30.967032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cd51f44a-cc7b-4ce5-9a48-f1eb20b9e057 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046798 Sep 19 11:34:30.967644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 788/1593] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:30.973582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.974058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.974498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:30.975233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:30.975749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:30.976177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:31.008349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1189d292-b433-4320-b27d-f38101fd8d75 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048815 Sep 19 11:34:31.009569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 806/1594] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:31.528287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:31.530530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:31.538881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:31.539412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:31.539854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:31.540563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:31.541022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:31.541456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:31.574390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c58304a9-ac3e-4586-a461-e71249a8ddee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050045 Sep 19 11:34:31.574972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 789/1595] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:31.786821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:31.788406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:31.795420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:31.795905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:31.796337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:31.797036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:31.797489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:31.797911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:31.942312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:31.950480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b03d92d0-056b-4970-ab90-f61cae5da51e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.169297 Sep 19 11:34:31.952524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 807/1596] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:31.979684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:31.982648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:31.989044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:31.989559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:31.990023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:31.990717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:31.991193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:31.991628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:32.021241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:32.022130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0f5e84f8-e379-4f28-8924-1e00271e6297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046444 Sep 19 11:34:32.022696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 790/1597] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:32.023455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:32.029813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:32.030294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:32.030729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:32.031448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:32.031903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:32.032328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:32.061843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f8e8b517-b6c7-4681-9660-5634f19d1ad4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Sep 19 11:34:32.062319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 808/1598] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:32.587418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:32.589570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:32.596093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:32.596570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:32.597009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:32.597692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:32.598144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:32.598573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:32.627799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-511bda84-fe2e-44d7-9ea1-27bf02dde996 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044412 Sep 19 11:34:32.628370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 791/1599] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:32.974287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:32.974895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:32.981067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:32.981547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:32.981981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:32.982673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:32.983162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:32.983615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:33.034895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:33.037121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:33.043779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:33.044268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:33.044718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:33.045432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:33.045893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:33.046326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:33.078997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9b317c4d-218c-460b-8f47-c35e1f0b850c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048008 Sep 19 11:34:33.079619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 792/1600] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:33.084363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:33.086402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:33.092893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:33.093378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:33.093819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:33.094514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:33.094972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:33.095429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:33.119638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:33.127587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-18df4bab-2c64-4c58-b779-b53917755bf1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157132 Sep 19 11:34:33.128114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3c9ce875-d68f-47b6-8cf9-7fe0cfe7f432 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047456 Sep 19 11:34:33.128290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 809/1601] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:33.128680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 793/1602] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:33.640871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:33.643005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:33.649122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:33.649596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:33.650030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:33.650721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:33.651197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:33.651622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:33.682390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6725e2c9-037f-447c-a2c0-9e7e9034b0e8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045550 Sep 19 11:34:33.682942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 810/1603] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:34.092143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:34.094306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:34.100838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.101320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.101757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.102448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.102900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.103357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.134478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1e486df1-8393-4afe-8cd4-502da2656e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046880 Sep 19 11:34:34.135049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 794/1604] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:34.140589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:34.142827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:34.149542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.150031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.150472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.151190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.151318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:34.151645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.151907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:34.152219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.158394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.158876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.159343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.160042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.160495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.160918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.179543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:34.182863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4653ed1d-f18c-4702-b7a5-4c4d399ed244 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046133 Sep 19 11:34:34.183477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 811/1605] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:34.296452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:34.304104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c3e29dd5-234c-429c-a8c7-ab7b7e943ef5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156614 Sep 19 11:34:34.304662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 795/1606] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:34.695859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:34.698023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:34.705039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.705517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.705952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.706673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:34.707126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:34.707580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:34.736301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7d972c29-1338-4de3-b6aa-7c9e877921f6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044468 Sep 19 11:34:34.736859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 812/1607] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:35.146171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:35.148349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:35.154956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.155466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.155899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.156577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.157025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.157444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.187316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e07e32b-6b37-4bd7-989c-8864602d6b68 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045068 Sep 19 11:34:35.187861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 796/1608] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:35.196385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:35.198555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:35.204763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.205268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.205699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.206375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.206823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.207278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.235756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0f6253b7-285f-4f34-b37a-affc7e7e9050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043219 Sep 19 11:34:35.236306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 813/1609] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:35.327581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:35.328179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:35.334124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.334604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.335036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.335741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.336184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.336600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.468322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:35.476052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-351d4c0a-c2b2-468e-9342-972feb4db67b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152560 Sep 19 11:34:35.476621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 797/1610] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:35.748203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:35.750346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:35.756712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.757195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.757632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.758320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:35.758775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:35.759220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:35.788681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-97d7525c-b8a0-4104-ad07-aee4935e82ad tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044509 Sep 19 11:34:35.789244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 814/1611] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:36.200244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:36.202419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:36.208887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.209380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.209816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.210511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.210968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.211432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.241477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30fc9b49-4f9c-4efd-b02d-86c190430eb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045485 Sep 19 11:34:36.242050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 798/1612] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:36.247857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:36.250017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:36.255948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.256415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.256843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.257518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.257962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.258382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.287612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7a9adfb4-bf57-4922-89dd-a382a043dbb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043693 Sep 19 11:34:36.288164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 815/1613] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:36.500393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:36.501004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:36.507001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.507515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.507952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.508635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.509090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.509512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.647583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:36.655962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5c892873-c7b6-439d-b8db-1c3f52e27d80 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159483 Sep 19 11:34:36.656568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 799/1614] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:36.802142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:36.804280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:36.810733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.811247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.811691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.812380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:36.812836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:36.813260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:36.844031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-adec4735-15cc-4281-8c47-0a775388c6cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045935 Sep 19 11:34:36.844593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 816/1615] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:37.254203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:37.256390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:37.263475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.263964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.264404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.265098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.265553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.265980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.297436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-afdb1d3c-871e-4e46-8dbd-acf9df9d9d7e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047214 Sep 19 11:34:37.297997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 800/1616] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:37.300373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:37.302518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:37.308472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.309544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.309984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.310683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.311137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.311599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.340343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2c37cef8-2f96-40eb-bd9a-4517091c7d95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044004 Sep 19 11:34:37.340944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 817/1617] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:37.679021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:37.679656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:37.685676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.686150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.686581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.687287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.687739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.688163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.819095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:37.827132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b6921d0d-e56d-4790-8ecf-82e0ae5521b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152035 Sep 19 11:34:37.827725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 801/1618] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:37.856658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:37.858706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:37.865112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.865589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.866023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.866704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:37.867149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:37.867605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:37.871296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:37.897253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a3b7fd27-ef69-49e7-b41a-b807a15775ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045167 Sep 19 11:34:37.897814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 818/1619] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:38.309820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:38.312010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:38.318429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.318913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.319398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.320105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.320559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.320988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.354468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:38.356680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:38.362792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-964b1bdb-3038-47f5-b655-f3344fca4f6f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056906 Sep 19 11:34:38.363523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 802/1620] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:38.363692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.364134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.364648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.365375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.365821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.366296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.395737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c1a0ed68-184b-42e3-8c7e-8fa548572fd5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Sep 19 11:34:38.396302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 819/1621] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:38.849835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:38.850506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:38.857016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.857499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.857939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.858630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.859085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.859538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.910024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:38.912189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:38.914538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:38.919871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.920359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.920795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.921490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:38.921945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:38.922367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:38.953121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-165c115e-031e-490a-8ead-f538e76c7c11 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047003 Sep 19 11:34:38.953704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 820/1622] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:38.990218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:38.998626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2a1273b4-2aa1-473f-a44d-4b9b4ed8235f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152624 Sep 19 11:34:38.999222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 803/1623] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:39.376869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:39.378969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:39.385304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:39.385790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:39.386255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:39.387562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:39.388041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:39.388473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:39.408596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:39.410875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:39.417214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:39.417711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:39.418182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:39.418799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-46f70a82-9ed5-4d3c-a5b2-741a6dfa80ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046310 Sep 19 11:34:39.418935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:39.419380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:39.419550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 821/1624] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:39.419817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:39.450515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b0439297-42fc-4594-bdaa-c5336f79e67e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045138 Sep 19 11:34:39.451079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 804/1625] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:39.967236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:39.969399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:39.975848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:39.976323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:39.976756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:39.977437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:39.977886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:39.978300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:40.008842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-195b5862-9b94-4304-bf68-af4b1eac4aa0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046326 Sep 19 11:34:40.009461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 822/1626] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:40.022003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:40.022624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:40.029931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:40.030418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:40.030857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:40.031592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:40.032073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:40.032500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:40.165439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:40.174111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0b71c399-903a-42c8-baad-05777ad81df3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156082 Sep 19 11:34:40.174777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 805/1627] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:40.431729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:40.433809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:40.439722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:40.440207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:40.440637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:40.441328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:40.441781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:40.442204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:40.463159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:40.465352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:40.473038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:40.473038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:40.473798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ce0f5aa-9b36-405f-91e0-c424efb02132 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044832 Sep 19 11:34:40.474532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:40.474647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 823/1628] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:40.474770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:40.474905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:40.475391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:40.506242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bfaa03cc-d741-4feb-b0e4-f538d273e8c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046929 Sep 19 11:34:40.506807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 806/1629] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:41.021912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:41.024131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:41.030959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.031482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.031916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.033234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.033234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.033513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.062829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1644b7d5-97b4-4f70-be58-5d22771f90f1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044948 Sep 19 11:34:41.063410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 824/1630] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:41.197445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:41.198052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:41.204801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.205283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.205720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.206407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.206857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.207378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.336455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:41.344891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fcbabd49-bdc2-4be9-9cb1-75f02966fd45 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151334 Sep 19 11:34:41.345459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 807/1631] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:41.485253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:41.487533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:41.493629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.494117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.497436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.497436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.497436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.497436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.518600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:41.520768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:41.527213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.527363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-edc92125-1fba-4681-a12d-4ea2471161a4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Sep 19 11:34:41.527475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.527475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.527721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 825/1632] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:41.529119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:41.529565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:41.529983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:41.558779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bb98f2b8-a528-4c7b-b99a-ce6fb7af0894 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044080 Sep 19 11:34:41.559265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 808/1633] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:42.076885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:42.079203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:42.085760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.086250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.086692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.087433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.087878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.088308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.119357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b164f96f-a038-45d6-8339-3aa17f47c612 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047350 Sep 19 11:34:42.119964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 826/1634] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:42.369809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:42.370418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:42.377645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.378139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.378565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.379297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.379756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.380184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.512799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:42.520620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-399df188-1773-4d3f-a061-619e232f224c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154906 Sep 19 11:34:42.521224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 809/1635] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:42.539809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:42.541982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:42.548571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.549273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.549941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.550987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.551706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.552348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.571827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:42.573968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:42.580258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.580770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.581509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.582730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:42.583563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:42.584316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:42.595412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e1ddaf98-5428-4533-b02c-a5e6a1c761b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059470 Sep 19 11:34:42.596000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 827/1636] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:42.617929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-80dda8ef-103d-487c-a0be-bbc5e1e7b4dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050070 Sep 19 11:34:42.618487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 810/1637] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:43.132881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:43.135072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:43.142021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.142496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.142932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.144061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.144160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.144510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.174265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c8533b66-0d92-4bee-9c0b-7e7a77feaa87 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045489 Sep 19 11:34:43.174831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 828/1638] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:43.544260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:43.544869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:43.551597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.552098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.552522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.553226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.553680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.554150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.608249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:43.610451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:43.618554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.624316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.624316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.624316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.624316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.624849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.653870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a0cc8697-22b4-405b-ba1b-2f021275e45c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049708 Sep 19 11:34:43.656491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 829/1639] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:43.673173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:43.673173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:43.673173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.673173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.673550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.673550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:43.673550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:43.673550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:43.704895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c49e8b6d-01d6-48a4-8de2-6d590abe9169 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Sep 19 11:34:43.704895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 830/1640] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:43.705144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:43.711423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b4aec581-251e-4e15-a645-4f6172975dd5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.171029 Sep 19 11:34:43.711989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 811/1641] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:44.186909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:44.189049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:44.195458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.195934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.196366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.197048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.197494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.197909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.227269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3b2d8b6b-45a1-45d8-aecd-b2a296d54ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044324 Sep 19 11:34:44.227816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 831/1642] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:44.680990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:44.683186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:44.689647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.690127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.690564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.691278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.691727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.692148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.695815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:44.715684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:44.718456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:44.723580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d1b1869-9cef-4039-a0ad-d43e686e2918 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046537 Sep 19 11:34:44.724156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 812/1643] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:44.724660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.725182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.725654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.726496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.726959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.727430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.733548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:44.734137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:44.740660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.741144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.741580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.742277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:44.742733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:44.743156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:44.758442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-211b7661-d07a-47d7-b22e-24d2aee75f44 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046599 Sep 19 11:34:44.759275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 832/1644] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:44.873399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:44.881240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-15676221-f262-40db-ad13-8dabf6b071eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151421 Sep 19 11:34:44.881839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 813/1645] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:45.240862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:45.243056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:45.250152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.250638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.251081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:45.251797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.252256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.252680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:45.282473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe0911ca-9f31-442d-8c77-dc4c69b277d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045760 Sep 19 11:34:45.283013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 833/1646] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:45.737226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:45.739464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:45.746071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.746591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.747028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:45.747749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.748266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.748693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:45.770869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:45.773108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:45.779727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.779927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bf6f89e7-a2fc-407a-9078-1c0c3c44c0c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046690 Sep 19 11:34:45.780210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.780524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 814/1647] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:45.780688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:45.781417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.781946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.782376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:45.808263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:45.812876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a7b6f193-939f-4709-84f6-ee99ccb88aa1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046066 Sep 19 11:34:45.813437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 834/1648] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:45.905049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:45.905660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:45.911747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.912233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.912672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:45.913369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:45.913826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:45.914259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:46.046874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:46.055286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d96b401c-aded-41da-a95f-58b2b0c5a622 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154652 Sep 19 11:34:46.055867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 815/1649] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:46.295499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:46.297637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:46.304081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:46.304565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:46.305001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:46.305684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:46.306135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:46.306555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:46.336594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-86e9aaa0-d42b-4fce-856b-8ff2ee415289 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045447 Sep 19 11:34:46.337150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 835/1650] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:46.792648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:46.794970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:46.802015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:46.802500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:46.802943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:46.803673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:46.804130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:46.804608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:46.826151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:46.828343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:46.834428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:46.834912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:46.835393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:46.835977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e6eb2cf-993a-4f9b-8bf2-62c7b06a7f73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047316 Sep 19 11:34:46.836129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:46.836523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:46.836648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 816/1651] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:46.837032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:46.866626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3cd88a30-5f70-41f8-a0ca-c325324b8dad tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044822 Sep 19 11:34:46.867194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 836/1652] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:47.078599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:47.079125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:47.085293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.085779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.086219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.086909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.087405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.087833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.217177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:47.225402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4552a427-d2eb-4903-9e23-acc47cc0e536 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151245 Sep 19 11:34:47.225964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 817/1653] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:47.349813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:47.351919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:47.359051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.359563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.360004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.360702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.361185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.361614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.391395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9891e87a-2aa4-4aaf-8974-a8950de74e3c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045629 Sep 19 11:34:47.391955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 837/1654] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:47.853986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:47.856144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:47.862711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.863217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.863653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.864343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.864790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.865206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.880565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:47.882746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:47.888659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.889150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.890199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.890926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:47.891415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:47.891851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:47.896398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fdff74cf-871d-4ab3-b5e3-487dae737845 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046013 Sep 19 11:34:47.896996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 818/1655] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:47.921069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1b096f3-bc15-4407-af44-1fd6400358ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Sep 19 11:34:47.921621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 838/1656] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:48.249353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:48.249971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:48.255965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.256449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.256884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.257567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.258022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.258445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.392289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:48.400291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-64f0e403-e7d5-4adf-b2fd-129a5a6a8719 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155355 Sep 19 11:34:48.400869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 819/1657] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:48 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:48.404363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:48.407786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:48.415095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.415611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.416040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.416743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.417192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.417614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.449111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e7905b8e-a9ff-4d0e-ac61-02ab03c02071 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048876 Sep 19 11:34:48.449907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 839/1658] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:48.908902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:48.911051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:48.917726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.918245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.918685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.919411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.919868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.920293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.933842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:48.936026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:48.942048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.942493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.942921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.943663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:48.944107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:48.944521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:48.950796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b2757c81-df85-4d21-be15-573714fc0e9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046402 Sep 19 11:34:48.951430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 820/1659] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:48.976367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-28bdcf0d-cfd5-4c56-991d-3046a65696a7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046569 Sep 19 11:34:48.976934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 840/1660] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:49.424614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:49.425300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:49.431051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:49.431631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:49.432063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:49.432742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:49.433194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:49.433614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:49.461325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:49.463610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:49.470363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:49.470851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:49.471319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:49.472017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:49.472473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:49.472904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:49.504448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-47efeb56-dfdc-4eee-9d2d-bb3effee86d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047006 Sep 19 11:34:49.505035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 841/1661] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:49.564262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:49.572066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3b04575f-c2ec-4f2a-984f-298c096013c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151344 Sep 19 11:34:49.572632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 821/1662] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:49.964034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:49.966248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:49.972985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:49.973466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:49.973900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:49.974587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:49.975040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:49.975503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:49.989369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:49.992346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:49.998708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:49.999219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:49.999666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:50.000357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:50.001067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:50.001493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:50.006148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9aed16d8-ff79-481a-8e06-88344ee7fe6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046204 Sep 19 11:34:50.006723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 842/1663] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:50.031119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-86fc8544-b150-4cd4-be32-c5678fb01b59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045715 Sep 19 11:34:50.031728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 822/1664] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:50.517440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:50.519668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:50.526153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:50.526637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:50.527079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:50.527802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:50.528262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:50.528691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:50.559024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-20fd3407-8e97-4eac-bb2b-0cb255130b6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046177 Sep 19 11:34:50.559617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 843/1665] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:50.595907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:50.596662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:50.602750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:50.603256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:50.603697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:50.604395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:50.604852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:50.605280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:50.737522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:50.745171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-27f937c8-bbab-4490-933a-4c2e6125d654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153828 Sep 19 11:34:50.745732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 823/1666] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:51.018986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:51.021205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:51.027192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.027694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.028227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.028977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.029436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.029907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.043746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:51.045856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:51.052661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.053155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.053598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.054436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.054894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.055363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.059955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-33d340ff-db74-4d5b-b7f5-4ce25ce538a2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045705 Sep 19 11:34:51.060521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 844/1667] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:51.086206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-48becb73-e91b-41f6-a321-879be26ada83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046571 Sep 19 11:34:51.086723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 824/1668] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:51.571974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:51.574110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:51.580800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.581286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.581726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.582413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.582868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.583324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.613952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c63f9365-6bd0-487a-96d1-a7e18b5cec30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045938 Sep 19 11:34:51.614512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 845/1669] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:51.768939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:51.769544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:51.771507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:51.776761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.778668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.778668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.778668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:51.779100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:51.779270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:51.921445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:51.930296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2b9fe6a3-4ee4-4885-9f4a-39a47a798ae9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.165168 Sep 19 11:34:51.931029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 825/1670] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:52.073411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:52.075865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:52.082559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.083049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.083515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:52.084215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.084672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.085101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:52.099676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:52.101927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:52.108654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.110987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.110987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:52.110987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.110987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.111366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:52.117387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a4ab2731-418a-4df5-8d9d-b2e298d1b4e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048029 Sep 19 11:34:52.118044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 846/1671] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:52.142702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-308096f9-4914-457e-bccd-ccfff130cf06 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047272 Sep 19 11:34:52.143283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 826/1672] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:52.627265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:52.629413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:52.635843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.636320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.636758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:52.637440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.637892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.638319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:52.667150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e5e4a377-ab3e-4a8f-8f38-6e30457e6d8b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044531 Sep 19 11:34:52.667728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 847/1673] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:52.953946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:52.954501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:52.960541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.961026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.961466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:52.962180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:52.962637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:52.963059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:53.095733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:53.103608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3221e714-12eb-48bf-be7f-970637c98a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153955 Sep 19 11:34:53.104231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 827/1674] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:53.130428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:53.132584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:53.138447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:53.138927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:53.139407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:53.140095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:53.140551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:53.140970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:53.154691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:53.157417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:53.163843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:53.164331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:53.164771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:53.165471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:53.165931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:53.166358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:53.173139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-47ebbda0-1749-4c98-afcc-899d512678c5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Sep 19 11:34:53.173716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 848/1675] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:53.191947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:53.196840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5ec18895-5584-42f5-a908-1103c877deb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046079 Sep 19 11:34:53.197410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 828/1676] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:53.680257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:53.682447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:53.689144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:53.689623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:53.690064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:53.690766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:53.691370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:53.691782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:53.723186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-74559949-6e3b-43fd-b9c6-57c374c58f2a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046888 Sep 19 11:34:53.723749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 849/1677] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:54.128271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:54.128878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:54.135393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.135893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.136347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.137037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.137496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.137922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.186972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:54.189186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:54.195290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.195780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.196224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.196929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.197386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.197815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.228091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7d9bd7a4-d8a7-423c-ae05-0c55288ee643 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045874 Sep 19 11:34:54.228856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 850/1678] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:54.233839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:54.236005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:54.241943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.242435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.242902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.243639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.244100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.244531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.262279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:34:54.273410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:54.278769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f5b2a4bf-b0b3-45fe-8a53-120603cd50ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045613 Sep 19 11:34:54.278769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 851/1679] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:54.281525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1de4fdcf-4ea4-4356-b03b-1e59650d272d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157694 Sep 19 11:34:54.282079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 829/1680] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:54.736619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:54.738751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:54.745408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.745879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.746307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.746982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:54.747463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:54.747882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:54.776158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-93de4985-529b-41fb-98f0-54e777551944 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044113 Sep 19 11:34:54.776704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 852/1681] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:55.240761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:55.242953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:55.250134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.250617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.251056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.251806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.252271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.252700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.282471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e9b2b29-5547-4544-9bfa-60299041b231 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 19 11:34:55.283878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 830/1682] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:55.288942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:55.291090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:55.297150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.297638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.298076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.298801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.299284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.299950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.304727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:55.305334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:55.311606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.312083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.312513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.313188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.313639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.314057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.335845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f58dd389-b6bd-4243-9320-4b6fd3b1f725 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044966 Sep 19 11:34:55.335845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 853/1683] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:55.443871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:55.452417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-993ed4d1-2de2-4571-9a56-86ee3dd11b48 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150855 Sep 19 11:34:55.452987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 831/1684] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:34:55.789305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:55.791608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:55.798611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.799213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.799660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.800358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:55.800815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:55.801244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:55.831658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-67cb3579-1b92-429d-828b-578ae8e85b7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046196 Sep 19 11:34:55.832219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 854/1685] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:56.294076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:56.296830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:56.303268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.303750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.304181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.304862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.305310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.305724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.334569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c36ab47a-472e-43a4-99a1-8c55b0e14c56 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044451 Sep 19 11:34:56.335125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 832/1686] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:56.341819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:56.344553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:56.350407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.350881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.351349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.352028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.352476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.352894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.382175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e4f4347a-b11b-4477-aea2-01845d87f897 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044130 Sep 19 11:34:56.382655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 855/1687] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:56.479422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:56.480080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:56.486527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.487012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.487477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.488175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.488626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.489048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.699318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:56.707926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-69ad4433-1768-44ed-b984-dca198b4100c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.232445 Sep 19 11:34:56.708499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 833/1688] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:56.844697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:56.846883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:56.853527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.854012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.854529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.855619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:56.856079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:56.856511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:56.887914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-25bf26fb-6c9d-479b-a2b6-ff404c95dabf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047556 Sep 19 11:34:56.888676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 856/1689] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:57.348075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:57.350226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:57.356805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.357288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.357735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.358435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.358889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.359347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.388774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c7c1182f-75b5-4000-b466-930ae850ce69 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Sep 19 11:34:57.389703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 834/1690] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:57.394639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:57.396854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:57.402988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.403587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.404022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.404791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.405729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.406157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.435233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-61bcd424-a5cb-4d4b-8cc4-eedc1fd2a4a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044591 Sep 19 11:34:57.436500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 857/1691] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:57.730773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:57.731344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:57.737529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.738023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.738461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.739151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.739636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.740062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.879330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:57.887008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ed09e71c-385f-4464-b704-03563499c999 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160222 Sep 19 11:34:57.887769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 835/1692] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:57.900282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:57.902727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:57.909450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.909987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.910450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.911150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:57.911633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:57.912112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:57.944674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf928ffe-359a-4d8f-86ce-2409f53c2104 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048435 Sep 19 11:34:57.945261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 858/1693] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:34:58.401926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:58.404029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:58.410983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.411510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.411950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:58.412643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.413098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.413526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:58.443507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3f85e6c4-f7e1-406c-95e1-1015850e7c9e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045631 Sep 19 11:34:58.444144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 836/1694] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:58.448075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:58.450519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:58.456769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.457257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.457699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:58.458398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.458852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.459314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:58.501121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-38be8b1c-ee8a-4d6b-beaf-b9ec0029a038 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057080 Sep 19 11:34:58.501740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 859/1695] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:34:58.911802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:58.912421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:58.918326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.918805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.919265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:58.920058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.920436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.920857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:58.958638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:58.960967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:58.968476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.968964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.969430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:58.970214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:58.970679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:58.971104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:59.001968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1221fa43-7218-4b8c-acca-8e713d197da4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047430 Sep 19 11:34:59.003226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 860/1696] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:34:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:34:59.051608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:34:59.059403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc73334c-fd27-439f-89e1-ad5e878bdce7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151438 Sep 19 11:34:59.059970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 837/1697] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:34:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:34:59.456284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:59.458482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:59.464571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:59.465058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:59.465498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:59.466196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:59.466654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:59.467113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:59.496810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1174e185-e45c-4c44-a170-84d93e75bbf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Sep 19 11:34:59.497417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 861/1698] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:34:59.513176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:34:59.515491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:34:59.522128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:59.522690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:59.523129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:59.523868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:34:59.524326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:34:59.524755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:34:59.556392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-767a2122-e458-4226-988e-d3ce2c1c4b35 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047333 Sep 19 11:34:59.556871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 838/1699] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:34:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:00.015431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:00.017628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:00.024479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.025145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.025593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.026304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.026761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.027219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.060935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ec49fdb3-2680-4e2c-b9fe-046bc68d09b3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049634 Sep 19 11:35:00.061536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 862/1700] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:00.083625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:00.084282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:00.090650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.091133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.091610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.092821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.093270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.093690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.422360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:00.430143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0fa4a22f-7c45-4432-8afe-309239aba020 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.350547 Sep 19 11:35:00.430717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 839/1701] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:00.509939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:00.512552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:00.521409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.521911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.522359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.523074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.523587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.524344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.557048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1638423d-4502-4e4e-9baa-6b300da6d3d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051010 Sep 19 11:35:00.557629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 863/1702] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:00.573716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:00.576317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:00.583718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.584206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.584642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.585346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:00.585795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:00.586219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:00.616408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5d645525-93bb-47a7-95cd-58d9bf7814bd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050479 Sep 19 11:35:00.617011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 840/1703] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:01.073144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:01.075668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:01.082065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.082603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.083044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.083769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.084223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.084649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.115189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2acde21a-a26d-4e9d-90bc-cbd6a3df26c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046105 Sep 19 11:35:01.115776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 864/1704] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:01.453572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:01.454211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:01.460149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.460657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.461090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.461777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.462230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.462656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.570385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:01.573481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:01.579280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.579787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.580364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.581251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.581816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.582262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.610054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:01.616285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-50e278a7-6465-42b6-9df6-bc624bb86514 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049858 Sep 19 11:35:01.616847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 865/1705] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:01.618247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a5da60a-22c5-4156-b9c1-4cee355c73c0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.168723 Sep 19 11:35:01.618822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 841/1706] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:01.628819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:01.630935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:01.636845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.637312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.637745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.638460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:01.639527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:01.639955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:01.668362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dce96612-a4b1-47cb-902f-da52c6954018 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043331 Sep 19 11:35:01.668912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 866/1707] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:02.128178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:02.130351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:02.136582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.137066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.137501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.138201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.138657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.139826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.169693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a1a62627-a15f-414d-a74f-ff554985269f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046327 Sep 19 11:35:02.170292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 842/1708] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:02.641167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:02.641785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:02.648081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.648619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.649014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.649712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.650172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.650602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.696016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:02.698418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:02.704923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.705412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.705851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.706545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.707158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.707666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.738423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a89d6307-2976-4bf6-bfcc-b5a979a1c877 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112578 Sep 19 11:35:02.739000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 867/1709] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:02.743861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:02.745984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:02.753545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.753931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.754379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.755076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:02.755555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:02.755984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:02.759828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:02.784165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:02.789753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f8f74484-8602-4766-aeae-b590aebeea1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046730 Sep 19 11:35:02.789753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 868/1710] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:02.792213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f78cacbf-ae71-4a9b-8e20-eb610d495702 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154980 Sep 19 11:35:02.792785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 843/1711] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:03.181955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:03.184124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:03.191514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.191996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.192422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.193108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.193558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.193978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.225571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-71ae7545-97fc-4edc-92e2-e226f5b008fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047452 Sep 19 11:35:03.226137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 869/1712] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:03.751059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:03.753237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:03.759689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.760169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.760602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.761287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.761739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.762161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.791844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f41d8406-3df0-4fae-b2eb-811a331ff4ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Sep 19 11:35:03.792408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 844/1713] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:03.800001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:03.802143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:03.804500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:03.809212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.809684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.810205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.811154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.811629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.816072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.816211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:03.816320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:03.822275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.822761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.823260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.823955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:03.824675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:03.825095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:03.842516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f58cb659-91eb-4415-a147-e44188c5c21e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046505 Sep 19 11:35:03.843097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 870/1714] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:03.844024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:03.955214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:03.963076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8fba189e-7523-46ac-a138-7e9ab91f4bb8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151367 Sep 19 11:35:03.963711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 845/1715] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:04.238716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:04.382907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:04.382907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.382907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.382907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:04.383414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.383414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.383414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:04.383414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8d2e0ac1-3077-4b66-9b38-9a752e65d4ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048782 Sep 19 11:35:04.383780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 871/1716] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:04.804927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:04.807100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:04.814255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.814739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.815191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:04.815891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.816354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.816771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:04.846233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bef5e104-1f5e-4eb6-b193-0fef78ee99a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045244 Sep 19 11:35:04.846791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 846/1717] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:04.854794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:04.856981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:04.863630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.864102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.864538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:04.865238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.865693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.866121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:04.895551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2a732aef-d296-4357-89d1-77b0a1b6382f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044667 Sep 19 11:35:04.896112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 872/1718] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:04.987146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:04.987776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:04.993744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.994223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.994655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:04.995362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:04.995811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:04.996230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:05.131942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:05.139948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-280d02c1-3867-41fa-acf8-d4d635a46674 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157329 Sep 19 11:35:05.140524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 847/1719] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:05.297269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:05.299495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:05.306684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:05.307163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:05.307624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:05.308310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:05.308758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:05.309177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:05.338147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c1fc215a-3239-4b7c-b8a2-7eed1622d3c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045309 Sep 19 11:35:05.338617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 873/1720] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:05.858891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:05.861082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:05.867891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:05.868553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:05.869137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:05.870059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:05.870530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:05.870959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:05.906223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-be99517e-8435-493e-84d0-5a6099fc24cc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051450 Sep 19 11:35:05.906807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 848/1721] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:05.908755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:05.910919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:05.916818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:05.917292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:05.917724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:05.918409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:05.918855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:05.919302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:05.948599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8e0c50cc-eb35-4fff-9b73-8a603dc42d9f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044400 Sep 19 11:35:05.949428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 874/1722] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:06.164026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:06.164588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:06.170712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.171305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.171751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:06.172447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.172904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.173331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:06.301713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:06.309730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0804307e-1b63-4812-a23d-d6ed9a2d1741 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149829 Sep 19 11:35:06.310298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 849/1723] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:06.350981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:06.353127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:06.360057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.360533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.360993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:06.361676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.362123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.362541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:06.392391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e5b30b2c-8712-4347-9a61-a456f79ce776 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045242 Sep 19 11:35:06.392904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 875/1724] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:06.918717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:06.921608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:06.928234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.928726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.929173 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:06.929920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.930397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.930830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:06.961821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:06.964297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2a87e630-6bc4-4ebc-a7c1-cd4828cb1b45 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049805 Sep 19 11:35:06.964669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:06.964874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 850/1725] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:06.972627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.972627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.973104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:06.973431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:06.973886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:06.974314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:07.004987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-608ce665-ae03-4bf7-89c7-4249e003236d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047271 Sep 19 11:35:07.005562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 876/1726] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:07.333799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:07.334470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:07.336483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:35:07.336633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:35:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:35:07.343281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:07.343777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:07.344216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:07.344913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:07.345373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:07.345802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:07.406497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:07.408717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:07.415282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:07.415816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:07.416267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:07.417020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:07.417507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:07.417936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:07.448869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1f424cbe-c06b-4ba3-97e2-f371dad1c6c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047019 Sep 19 11:35:07.449902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 877/1727] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:07.486792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:07.490871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-426a417f-2d86-4d20-bed8-d5bd750bcc46 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160999 Sep 19 11:35:07.491480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 851/1728] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:07.977083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:07.979279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:07.986128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:07.986613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:07.987139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:07.987789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:07.988244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:07.988673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:08.018344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:08.020248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e1c4c9a8-a02d-4d59-98e7-d5c82759b1ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047539 Sep 19 11:35:08.020798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:08.020951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 878/1729] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:08.028241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:08.028761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:08.029751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:08.030455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:08.030909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:08.031377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:08.061437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-433c4eaf-0bde-420f-a2a7-82f70fbb3164 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047741 Sep 19 11:35:08.062018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 852/1730] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:08.462538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:08.464740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:08.472401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:08.472890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:08.473329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:08.474036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:08.474486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:08.474983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:08.505339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d215df72-efa4-445b-84c1-e9e729694e81 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047144 Sep 19 11:35:08.505923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 879/1731] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:08.514375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:08.514984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:08.521021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:08.521499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:08.521941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:08.522685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:08.523137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:08.523599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:08.662505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:08.670326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a57f1aba-5437-4b2e-821e-b26ae4861939 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160292 Sep 19 11:35:08.670899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 853/1732] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:09.032300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:09.034426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:09.040404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.040883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.041313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.041990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.042440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.042860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.072697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dcd39a44-91aa-48bd-9fcb-fd5922e8bfac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044301 Sep 19 11:35:09.073461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 880/1733] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:09.074329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:09.077212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:09.083325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.083813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.084252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.084952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.085416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.085843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.115467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-86909fcd-fc7d-4848-986a-d8f5e9b0b4c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045285 Sep 19 11:35:09.116050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 854/1734] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:09.518296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:09.520663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:09.522660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:35:09.522810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:35:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments (ip 10.222.0.78) !!! Sep 19 11:35:09.531194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.534824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.534824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.534824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.534824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.535254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.564968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-42933fcb-f42e-4d09-a273-2cf8670470d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050757 Sep 19 11:35:09.567580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 881/1735] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:09.694038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:09.694648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:09.700979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.701460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.701903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.702591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:09.703044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:09.703528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:09.835882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:09.844033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f538d8be-aa05-4ab6-9f02-d94599122e32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153988 Sep 19 11:35:09.844596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 855/1736] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:10.086009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:10.088235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:10.094856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.095395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.095841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:10.096542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.097051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.097471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:10.127025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-23384542-cbc6-47f3-b34b-d5606c9f6afd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044940 Sep 19 11:35:10.127628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 882/1737] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:10.127967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:10.130177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:10.136517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.136999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.137427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:10.138107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.138556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.139521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:10.168149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ccb8fd3b-6efb-43d8-91ae-c54a4361a766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044053 Sep 19 11:35:10.168700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 856/1738] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:10.579698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:10.581917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:10.589465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.589986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.590428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:10.591131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.591612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.592077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:10.622155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f329d40a-31aa-44b4-8357-85515a09e3d3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048324 Sep 19 11:35:10.622711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 883/1739] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:10.867653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:10.868187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:10.874861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.875367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.875809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:10.876499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:10.876958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:10.877389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:11.011199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:11.019186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b5d9fa67-d415-4a90-80fa-e9025f300408 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155456 Sep 19 11:35:11.019782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 857/1740] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:11.139933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:11.147004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:11.147004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:35:11.147004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:35:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments (ip 10.222.0.78) !!! Sep 19 11:35:11.156190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:11.156190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:11.156608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:11.157367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:11.157827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:11.158288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:11.180707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:11.182902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:11.184888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:11.189706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-91b2fe7e-834d-4e6b-b826-f4a2557f4007 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053813 Sep 19 11:35:11.189918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:11.190281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 884/1741] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:11.190394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:11.190822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:11.191644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:11.192098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:11.192523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:11.223250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-139658e2-ea2e-4b4c-861d-ce7bcaad7367 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046459 Sep 19 11:35:11.223812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 858/1742] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:11.636193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:11.638354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:11.645449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:11.645929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:11.646368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:11.647055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:11.647537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:11.647963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:11.677113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8fe7048f-ca47-4612-b1b5-5128043eecc5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045398 Sep 19 11:35:11.677664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 885/1743] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:12.043688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:12.044323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:12.050906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.051435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.051931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.052627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.053086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.053514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.183649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:12.192602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8bda79f9-8c58-4e27-aa25-cbf3aa92d1b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153074 Sep 19 11:35:12.193165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 859/1744] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:12.202145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:12.204353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:12.210344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.210824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.211292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.211988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.212505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.212865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.236581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:12.238749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:12.244363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-99a0ccbf-b33b-4ef5-ae25-0fbdcfcc4fda tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046395 Sep 19 11:35:12.244651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.244929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 886/1745] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:12.245142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.245581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.246355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.246819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.247277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.276875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54e9a215-b173-49a2-aa3e-a30712ba0f59 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Sep 19 11:35:12.277436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 860/1746] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:12.689670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:12.691763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:12.698204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.698690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.699481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.700176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:12.700627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:12.701057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:12.730765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-abf84263-50d4-4574-9313-2e90eac3d415 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045738 Sep 19 11:35:12.731357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 887/1747] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:13.216250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:13.216964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:13.223964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.224454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.224893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.225594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.226054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.226484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.257573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:13.260119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:13.266518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.267003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.267466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.268167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.268645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.269069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.303066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e81cb4ce-ff05-4090-a4aa-8d38736d1b26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049782 Sep 19 11:35:13.303676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 888/1748] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:13.308401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:13.310557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:13.316547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.317093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.317470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.318172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.318628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.319703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.364620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-94c99999-675d-4946-bf5e-849a24568158 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059378 Sep 19 11:35:13.365786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 889/1749] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:13.397322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:13.405510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c55bcb58-1362-4969-8ffb-7afab67c1a69 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.193092 Sep 19 11:35:13.406089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 861/1750] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:13.743717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:13.745947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:13.752409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.752889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.753326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.754052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:13.754507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:13.754927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:13.784805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45a918c0-9d96-4187-be6e-d59761f7df59 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045260 Sep 19 11:35:13.785386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 890/1751] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:14.315520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:14.317671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:14.324345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.324823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.325253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.325931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.326380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.326797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.330435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:14.355202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2a1bbd9e-c6b7-4a9f-9798-803b4cd4aab7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044275 Sep 19 11:35:14.355764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 862/1752] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:14.378658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:14.380801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:14.386803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.387326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.387773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.388465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.388923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.389384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.418922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c28830a5-618b-4155-bb52-e17c28a1577e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044894 Sep 19 11:35:14.419525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 891/1753] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:14.429967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:14.430572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:14.436610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.437080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.437509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.438823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.439299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.439717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.567448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:14.575349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4f1ac75d-b5d7-4784-9b15-3d5972276e67 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149540 Sep 19 11:35:14.575909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 863/1754] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:14.799098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:14.801302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:14.807697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.808186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.808624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.809313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:14.809771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:14.810202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:14.839356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-df8bbfd8-b961-4c7b-9ef9-c14a2b359171 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044956 Sep 19 11:35:14.839932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 892/1755] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:15.368471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:15.370701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:15.377548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.378026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.378457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.379142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.379618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.380039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.409966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d308f9d-b243-451f-b76d-6f6b8bc84431 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045469 Sep 19 11:35:15.410517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 864/1756] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:15.432371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:15.434497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:15.440731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.441212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.441640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.442329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.442774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.443212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.473012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aaa50efb-367f-4bfb-8f31-075e14893b0a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044853 Sep 19 11:35:15.473575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 893/1757] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:15.597851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:15.598460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:15.604447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.604934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.605366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.606049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.606508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.606931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.739025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:15.746717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-663f20af-c743-4e9f-989d-0044bf7c7580 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152827 Sep 19 11:35:15.747410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 865/1758] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:15.853263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:15.855441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:15.862379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.862864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.863345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.864050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:15.864508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:15.864935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:15.894372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-88a15858-62df-4ca3-818b-8a3c187be3e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045357 Sep 19 11:35:15.894923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 894/1759] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:16.423330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:16.425458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:16.431984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.432472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.432914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.433611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.434069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.434496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.465240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0c80a782-908b-49ce-97c1-8687534d6c1c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046585 Sep 19 11:35:16.465798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 866/1760] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:16.486243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:16.488464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:16.494461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.494947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.495434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.496128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.496587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.497019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.525878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d7c68aa2-fe63-45f4-81c5-cdba6e32b474 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044261 Sep 19 11:35:16.526426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 895/1761] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:16.770807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:16.771481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:16.777449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.777936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.778372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.779066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.779547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.779973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.906198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:16.909677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:16.910761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:16.916147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.916632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.917072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.917777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:16.918231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:16.918665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:16.918933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f0bae9b2-63ad-4354-859b-24cd1a60292f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151905 Sep 19 11:35:16.919625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 867/1762] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:16.950459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-664d8f61-46fb-40eb-866a-69cfdaeb1620 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048337 Sep 19 11:35:16.951019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 896/1763] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:17.478119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:17.480271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:17.487530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.488011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.488445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.489129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.489576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.489997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.519641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-52fa5144-9956-4c75-8cc9-392d74f41c55 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Sep 19 11:35:17.520195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 868/1764] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:17.537901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:17.540153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:17.546211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.546694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.547133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.548364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.548816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.549255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.578400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8a8ddb14-19ab-43ee-a0b3-028242e1adb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044413 Sep 19 11:35:17.578991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 897/1765] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:17.942620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:17.943257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:17.949554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.950080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.950521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.951307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.951768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.952199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.962875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:17.965057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:17.972136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.972663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.973102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:17.973809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:17.974272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:17.974702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:18.006451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a9a2ab75-5a5a-4676-acbc-5044ea12c5eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047542 Sep 19 11:35:18.007250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 898/1766] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:18.085627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:18.093315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-741f6128-72e6-4575-9af6-0dcd3c9f940f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154668 Sep 19 11:35:18.093885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 869/1767] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:18.532284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:18.534425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:18.540422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:18.541010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:18.541315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:18.542002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:18.542453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:18.542873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:18.573560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-080bff33-898b-49e5-8edd-3eb231c20401 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Sep 19 11:35:18.574389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 899/1768] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:18.590373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:18.592742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:18.599211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:18.599700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:18.600173 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:18.600869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:18.601319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:18.601745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:18.631987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa86f567-e374-4904-b946-95db14f4844a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Sep 19 11:35:18.632557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 870/1769] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:19.019767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:19.021939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:19.028257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.028733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.029166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.029849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.030304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.030728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.060030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-78cf0db6-dd61-4f70-8b0f-c06593997481 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044816 Sep 19 11:35:19.060587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 900/1770] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:19.117139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:19.117491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:19.123540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.124029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.124467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.125153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.125630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.126058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.257404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:19.265125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f3b919e1-b5ee-41ed-85eb-9d761e40170f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152126 Sep 19 11:35:19.265692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 871/1771] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:19.586272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:19.588478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:19.595286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.595774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.596216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.596908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.597365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.597794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.615193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:19.628113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-207fc7d7-3995-4599-9354-f50b9674e050 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045937 Sep 19 11:35:19.628744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 901/1772] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:19.644696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:19.647457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:19.654133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.654618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.655049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.655769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:19.656218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:19.657204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:19.686214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4a683748-31a9-4d75-9c66-bbe222df748f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046065 Sep 19 11:35:19.686770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 872/1773] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:20.073514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:20.075979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:20.083065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.083572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.084003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.084696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.085151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.085579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.115229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-864e6f9f-08b8-4a56-8cfa-512fbcb64410 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046240 Sep 19 11:35:20.115791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 902/1774] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:20.288074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:20.288682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:20.294757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.295282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.295713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.296405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.296857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.297785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.436387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:20.445291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c86a8a42-3cd7-4152-aecf-ef26e70ac5a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.161062 Sep 19 11:35:20.445875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 873/1775] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:20.640197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:20.642542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:20.648614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.649100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.649547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.650241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.650699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.651126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.681557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b555a4a3-fcff-483c-86e8-14a21b63aeb6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045417 Sep 19 11:35:20.682113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 903/1776] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:20.701380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:20.705152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:20.714339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.714825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.715294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.715999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:20.716455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:20.716883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:20.755817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3fbedca1-3a5e-4523-9fee-3063dd28b6db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061815 Sep 19 11:35:20.756381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 874/1777] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:21.127014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:21.129161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:21.135546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.136018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.136448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.137129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.137603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.138016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.168424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6d6db4f3-3803-4dc1-bd46-668dff9c3b05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045340 Sep 19 11:35:21.168973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 904/1778] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:21.468748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:21.469779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:21.471744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:21.476469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.476952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.477390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.478081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.478539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.478968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.614025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:21.621806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-383e0327-686d-4f29-81f2-ce9818b41de6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157065 Sep 19 11:35:21.622363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 875/1779] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:21.694039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:21.696187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:21.702397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.702875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.703341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.704021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.704471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.704892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.735606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-927fa130-2d9a-4c20-8560-1d20ca4a9822 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044792 Sep 19 11:35:21.736081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 905/1780] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:21.768759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:21.770964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:21.777426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.777905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.778340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.779031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:21.779512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:21.779940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:21.809577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a84c851-0a19-4461-a13d-a9b3e4f62747 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045279 Sep 19 11:35:21.810135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 876/1781] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:22.181283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:22.183500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:22.190370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.190851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.191318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.192008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.192457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.192882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.223332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cde564ad-0baa-47c0-93ca-2f04203ad60f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046046 Sep 19 11:35:22.223904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 906/1782] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:22.644989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:22.645587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:22.651784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.652265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.652704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.653387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.653841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.654264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.747832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:22.750054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:22.760474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.763363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.763363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.763363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.763363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.764062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.795253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:22.796155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5defbd27-9ac2-45cf-a115-fb37b9c75b3c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052078 Sep 19 11:35:22.796762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 907/1783] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:22.801812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bc20867b-8c87-4d58-94aa-8f55cf48361f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160734 Sep 19 11:35:22.802375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 877/1784] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:22.821798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:22.824249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:22.830032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.830504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.830942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.831660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:22.832092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:22.832512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:22.861415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cd2745d8-4877-4c49-8c53-861cdf41c685 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043392 Sep 19 11:35:22.861972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 908/1785] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:23.236784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:23.239071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:23.245245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.245538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.245975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.246655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.247099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.247544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.272972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:23.277676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a5a634c0-7c3d-403f-bdc6-945a597f02cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045627 Sep 19 11:35:23.278233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 878/1786] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:23.809654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:23.811809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:23.818639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.819116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.819584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.820275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.820722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.821143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.825078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:23.825693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:23.832619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.833102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.833540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.834235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.834696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.835124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.851540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3d291bfb-38a5-4290-9791-e72d91c8926a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045909 Sep 19 11:35:23.852113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 909/1787] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:23.873643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:23.875816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:23.881671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.882148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.882577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.883293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:23.883742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:23.884160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:23.915244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-869888ec-7861-43c2-a8b9-94b442098bd9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045398 Sep 19 11:35:23.915828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 910/1788] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:23.970667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:23.978482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9a101171-306f-4feb-a5d0-779e57e21564 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157526 Sep 19 11:35:23.979052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 879/1789] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:24.290910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:24.293043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:24.298994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.299496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.299930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.300604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.301050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.301470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.330592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-83390f68-4961-4ec9-8264-03ec043ede4e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043641 Sep 19 11:35:24.331130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 911/1790] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:24.864726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:24.866890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:24.873340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.873817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.874251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.874941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.875416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.875841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.905580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-00052764-f798-4e98-b8ec-f2e991ea5a80 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045340 Sep 19 11:35:24.906138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 880/1791] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:24.928131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:24.930315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:24.936760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.937245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.937703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.938405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:24.939524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:24.939957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:24.969129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a4661163-64d5-4009-8ea0-c9720683843f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044933 Sep 19 11:35:24.969688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 912/1792] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:25.002748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:25.003411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:25.009503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.010005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.010445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.011135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.011612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.012035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.140081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:25.148063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-86aa7c3d-b6a6-4a2d-b18b-ecd84437a8da tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149744 Sep 19 11:35:25.148637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 881/1793] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:25.343213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:25.345328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:25.351724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.352202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.352634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.353308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.353754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.354171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.382995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b19a8963-6658-45a9-80ec-969f9f593109 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043669 Sep 19 11:35:25.383495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 913/1794] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:25.918300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:25.920498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:25.927113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.927772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.928218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.928916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.929375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.929802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.961142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0bface2a-45da-48ec-9732-937cfba22f4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047019 Sep 19 11:35:25.961703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 882/1795] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:25.981514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:25.983715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:25.990106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.990616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.991056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:25.991772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:25.992225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:25.992649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.023532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad9e8ce7-1bf1-4a1b-b2f2-67eade1f34e4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Sep 19 11:35:26.024111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 914/1796] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:26.172033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:26.172599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:26.178743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.179268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.179700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.180393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.180844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.181267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.310171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:26.318505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a35c5e8e-bf35-42a4-8648-fabd7d40138d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150607 Sep 19 11:35:26.319073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 883/1797] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:26.395443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:26.397563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:26.403530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.403995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.404424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.405106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.405551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.405973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.435666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f6cc0961-307d-4e35-ad81-60365d048f30 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044066 Sep 19 11:35:26.436172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 915/1798] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:26.974466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:26.976723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:26.983793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.984260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.984698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:26.985421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:26.985865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:26.986291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.016209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-32c0e13d-7dbb-4727-8db2-6e0c906de1c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046305 Sep 19 11:35:27.016780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 884/1799] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:27.036787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:27.038971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:27.045640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.046166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.046646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.047390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.047851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.048283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.077351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-86b1bc88-feb3-4982-a864-6976d67e61ca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Sep 19 11:35:27.077837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 916/1800] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:27.341922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:27.342474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:27.344446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:35:27.344594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:35:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:35:27.350838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.351353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.351792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.352483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.352936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.353359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.449274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:27.451616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:27.458165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.458751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.459291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.460068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:27.460602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:27.461040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:27.487008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:27.490734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d534844e-b92a-4622-8a81-8feff50c2082 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045804 Sep 19 11:35:27.491342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 917/1801] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:27.494714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d56d9719-b317-408e-8acf-beda4724d715 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156716 Sep 19 11:35:27.495306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 885/1802] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:28.029029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:28.031266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:28.037332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.037934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.038246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.038942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.039425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.040130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.044402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:28.071635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5a76fba7-d5e7-4246-b081-190526b4bc1f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046655 Sep 19 11:35:28.072209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 918/1803] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:28.089937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:28.092161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:28.099265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.099761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.100201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.100893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.101351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.101779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.131760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fd9db919-ea89-4da8-a13d-253e2df18b9b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Sep 19 11:35:28.132323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 886/1804] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:28.504099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:28.506271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:28.512433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.512924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.513368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.514067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.514524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.514955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.518368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:28.518988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:28.525157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.525649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.526093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.526796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:28.527387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:28.527823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:28.546494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-84c8da42-ec16-4d28-89f3-4f07e0179441 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046759 Sep 19 11:35:28.547252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 919/1805] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:28.657437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:28.665825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d5c09a9d-822e-41a7-973c-7a0f5ca77345 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151864 Sep 19 11:35:28.666396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 887/1806] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:29.085223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:29.087655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:29.091320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:29.097198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.100010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.100010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.100010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.100010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.100415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.130437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b31d278e-7908-4aca-8ccd-050f85979369 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049829 Sep 19 11:35:29.130995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 920/1807] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:29.144811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:29.147062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:29.153615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.154102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.154543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.155275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.155737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.156162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.185724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f15e5bbc-5d01-4f2e-8a37-e7bc587320ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045465 Sep 19 11:35:29.186286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 888/1808] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:29.558983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:29.561297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:29.567876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.568358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.568795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.569488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.569945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.570377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.600792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-226308b3-1bc2-4198-9b9a-c301ebd19ea9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045805 Sep 19 11:35:29.601519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 921/1809] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:29.689675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:29.690294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:29.696323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.696810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.697253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.697950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:29.698666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:29.699091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:29.832360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:29.840186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bd613f4a-9d5f-44ed-9798-b857a9e094ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155063 Sep 19 11:35:29.840790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 889/1810] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:30.143471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:30.145610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:30.151975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.152456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.152889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:30.153579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.154030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.154455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:30.184039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0928b6f6-e34f-4df6-857f-2c0ff11d24ec tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 Sep 19 11:35:30.184603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 922/1811] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:30.197867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:30.200331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:30.207228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.207716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.208143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:30.208826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.209272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.209691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:30.239280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-60d06d11-e257-4fa6-a430-d992e818a444 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Sep 19 11:35:30.239844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 890/1812] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:30.613620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:30.615798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:30.621809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.622295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.622735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:30.623463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.623949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.624378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:30.654437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1f887e29-a9b6-439e-b8fb-799b04f117c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044859 Sep 19 11:35:30.655006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 923/1813] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:30.864396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:30.864929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:30.870903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.871424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.871863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:30.872557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:30.873014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:30.873445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:31.005659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:31.013443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d9e0fa80-cf9f-4e62-9a33-4c078a86fee9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153500 Sep 19 11:35:31.014017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 891/1814] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:31.196593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:31.198998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:31.205470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:31.206001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:31.206446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:31.207141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:31.207627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:31.208087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:31.238764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce357354-53b9-4129-8975-15fd0833c66a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046142 Sep 19 11:35:31.239358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 924/1815] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:31.252415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:31.254577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:31.261026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:31.261511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:31.261950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:31.262641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:31.263097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:31.263559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:31.292460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7ff53418-a61a-4a49-84f5-5ff405a20bac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044026 Sep 19 11:35:31.293022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 892/1816] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:31.667336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:31.669432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:31.675430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:31.675923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:31.676362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:31.677058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:31.677512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:31.677946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:31.707828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e51f5d7-c950-4eb4-afbb-968c3f268536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044563 Sep 19 11:35:31.708378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 925/1817] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:32.036865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:32.037479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:32.043638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.044129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.044574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.045269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.045760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.046190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.212191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:32.220425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f8480368-62d3-415f-ba43-c0e176dbd8a1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.187422 Sep 19 11:35:32.221005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 893/1818] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:32.251655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:32.254557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:32.262126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.262126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.262454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.263011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.263943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.263943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.298311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce460359-a43f-4b45-b5c1-42a982aa5bf3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050581 Sep 19 11:35:32.299455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 926/1819] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:32.305739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:32.308759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:32.316847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.317462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.317912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.318622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.319077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.319528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.350094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-affcd9de-7838-44d5-a6d5-18d0d48c3fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048261 Sep 19 11:35:32.350658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 894/1820] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:32.721579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:32.723734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:32.729720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.730210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.730634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.731437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:32.731886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:32.732422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:32.764955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7aa0b9bb-c833-4913-8e14-41af44106b10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048001 Sep 19 11:35:32.766010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 927/1821] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:33.246533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:33.247192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:33.253257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.253740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.254184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.254876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.255373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.255803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.274471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:33.311797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:33.314131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:33.320784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.321277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.321718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.322417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.322877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.323613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.355323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-86bb3a3a-0285-4763-af41-0fae79841166 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047624 Sep 19 11:35:33.357039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 928/1822] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:33.363517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:33.365652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:33.371645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.372067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.372507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.373207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.373660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.374083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.391323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:33.399841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f9b23b70-9afe-4143-958f-de487bfaf9fc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157061 Sep 19 11:35:33.400354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 895/1823] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:33.404550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2f064fef-366c-4a10-be0a-49618debc3bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044781 Sep 19 11:35:33.405108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 929/1824] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:33.778050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:33.780236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:33.786197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.786675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.787111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.787823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:33.788275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:33.788698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:33.819492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-26a82cba-4682-4db4-b674-c7e9960fd591 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045392 Sep 19 11:35:33.820055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 896/1825] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:34.368522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:34.370579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:34.376792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.377274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.377719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.378416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.378875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.379345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.409474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b5810fa0-17e0-491f-a22a-6b4bfb52aed1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044983 Sep 19 11:35:34.410028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 930/1826] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:34.416964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:34.419214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:34.421590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:34.422192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:34.426558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.427045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.427590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.428239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.428692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.428820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.429109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.429290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.429726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.430427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.430881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.431343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.458742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7692cf2e-5052-4953-b8a4-a72bf44ba78d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045749 Sep 19 11:35:34.459376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 897/1827] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:34.604305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:34.612035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0b33bd40-805f-40fb-b0d7-c3781ecc9bad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.194296 Sep 19 11:35:34.612606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 931/1828] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:34.833473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:34.835712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:34.841682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.842162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.842594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.843376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:34.843836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:34.844250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:34.873927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fc369c4d-4809-4b0b-a127-ee65256da05b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045391 Sep 19 11:35:34.874473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 898/1829] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:35.422245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:35.424993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:35.432244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.432730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.433158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.433851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.434295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.434750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.464780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e0ec5830-8a83-44d2-b938-c7b23a0ae7b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046528 Sep 19 11:35:35.465337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 932/1830] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:35.471712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:35.473849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:35.480505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.480994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.481436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.482134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.482592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.483024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.513529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-df62e8d1-5d4d-4a16-bd99-13fa8de0a4fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045659 Sep 19 11:35:35.514102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 899/1831] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:35.634333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:35.634975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:35.641062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.641553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.641992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.642727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.643196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.643632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.777656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:35.785978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d8a5936-e5db-4975-a0c7-a1badc153322 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155513 Sep 19 11:35:35.786555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 933/1832] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:35.887235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:35.889400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:35.895382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.895908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.896307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.897002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:35.897458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:35.897884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:35.928133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-125ab10c-7781-4f28-9de5-984a3a8a5dd9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044867 Sep 19 11:35:35.928693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 900/1833] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:36.477267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:36.479404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:36.485797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.486290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.486734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.487477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.487939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.488371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.516796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:36.522240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0bd9c049-3c1d-4e4e-8974-1ee3dfca7cc5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049025 Sep 19 11:35:36.522817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 934/1834] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:36.526053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:36.528311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:36.534793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.535320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.542260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.542260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.542260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.542260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.567723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9c2f5f4e-b172-446e-8298-32909525ed57 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045618 Sep 19 11:35:36.568309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 901/1835] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:36.810806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:36.811464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:36.820750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.821256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.822763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.823764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.824228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.824679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.940947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:36.943130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:36.949535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.950018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.950477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.951221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:36.951678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:36.952594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:36.962827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:36.970985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4610291-94ff-48f7-8cdc-289d3897713b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.164356 Sep 19 11:35:36.971590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 935/1836] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:36.982676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-92dd0c40-cad4-4fe7-a14a-1aad56e81827 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046254 Sep 19 11:35:36.983435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 902/1837] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:37.534669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:37.536833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:37.543356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:37.543839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:37.544276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:37.544962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:37.545413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:37.545835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:37.575892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b4683c79-0d0d-4a46-9e52-c2c3ce41d23e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Sep 19 11:35:37.576450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 936/1838] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:37.580185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:37.582355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:37.588892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:37.589375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:37.589816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:37.590509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:37.590965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:37.591415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:37.621898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6c6d2307-a66b-400a-aa32-4d10b19e4955 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Sep 19 11:35:37.622486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 903/1839] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:37.994630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:37.995287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:37.995936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:37.998256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:38.001415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.001903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.002339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.003059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.003550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.003977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.004199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.004751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.005196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.005897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.006435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.006815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.038181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49748659-d06d-4f7b-a0f9-d13f7a5b8191 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046614 Sep 19 11:35:38.038769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 904/1840] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:38.140071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:38.148517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-737c9180-e32f-476b-8022-5b8406cec982 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157953 Sep 19 11:35:38.149087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 937/1841] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:38.588404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:38.590695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:38.597900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.598379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.598821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.599551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.600009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.600441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.630822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c457671b-408f-4bc3-bc19-3584b57e9642 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046374 Sep 19 11:35:38.631414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 905/1842] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:38.634148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:38.636385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:38.642847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.643373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.643816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.644518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:38.644969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:38.645397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:38.675307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3801d017-9727-4041-a385-421d33826eec tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Sep 19 11:35:38.675869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 938/1843] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:39.050980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:39.053138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:39.059246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.059733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.060172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.060855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.061308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.061727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.091820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2a5c9f05-b0f9-4c71-9072-5a143fbc558b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044978 Sep 19 11:35:39.092395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 906/1844] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:39.172453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:39.173177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:39.179373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.179866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.180340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.181036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.181493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.181922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.312030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:39.320255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1a839b39-43a7-4949-a307-cc6c01632d95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152395 Sep 19 11:35:39.320774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 939/1845] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:39.642703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:39.645390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:39.651672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.663429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.663429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.663429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.663429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.663814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.684349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-844655df-8346-4ff3-957f-0bc7e2f66913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045729 Sep 19 11:35:39.684917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 907/1846] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:39.687912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:39.690692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:39.697041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.697529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.697974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.698917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:39.699399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:39.699831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:39.729028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad13e0cb-f52c-4a60-baea-c31eebe0ebcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Sep 19 11:35:39.729594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 940/1847] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:40.104614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:40.106772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:40.113962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.114459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.114882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.115633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.116083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.116506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.145868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9a394022-cbcf-4815-bc17-55e071dcf8ac tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045273 Sep 19 11:35:40.146431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 908/1848] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:40.343791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:40.344402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:40.350976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.351493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.351935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.352627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.353081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.353513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.482948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:40.490776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8d8908bc-3ae8-4d9e-a03a-bcee7a96b1fa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151035 Sep 19 11:35:40.491387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 941/1849] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:40.696570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:40.698963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:40.705250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.705739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.706205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.706901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.707881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.708337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.738076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-28fd4b5a-2533-4d07-970a-1af09281a969 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045512 Sep 19 11:35:40.738657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 909/1850] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:40.741963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:40.744275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:40.750589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.751115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.751587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.752292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:40.752747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:40.753173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:40.782867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-093c5361-bb6c-4c0f-b4c2-ff5c449e6e6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Sep 19 11:35:40.783453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 942/1851] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:41.158526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:41.161250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:41.167624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.168102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.168533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.169874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.169874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.170138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.200092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b05bc3b9-44a5-424c-a6bb-b0e674914331 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045592 Sep 19 11:35:41.200649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 910/1852] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:41.513881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:41.514487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:41.521012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.521478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.521909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.522584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.523031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.523479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.656281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:41.664086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-757aa798-1cfc-4ea6-8eef-08df47fda9ad tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154101 Sep 19 11:35:41.664649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 943/1853] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:41.750465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:41.752686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:41.759525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.760017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.760456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.761149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.761606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.762062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.793823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cc645dce-b52c-490d-88d6-b2d0781a6b8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047205 Sep 19 11:35:41.794313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 911/1854] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:41.796944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:41.797758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:41.804780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.805268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.805707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.806411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:41.806867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:41.807324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:41.837302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cbea2fcf-907f-4df8-bf2f-24d3f0d7463c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045774 Sep 19 11:35:41.837869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 944/1855] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:42.213227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:42.215435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:42.222003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.222484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.222923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.223650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.224105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.224532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.228236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:42.255443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-82356826-1ccc-4263-9dc3-7a9983db4721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046278 Sep 19 11:35:42.256010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 912/1856] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:42.686459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:42.687096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:42.693133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.693636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.694066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.694755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.695230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.695663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.805970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:42.808364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:42.814897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.815491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.815997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.816934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.817454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.817947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.825724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:42.834089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f779b532-4f32-447e-b025-a79ad30d3866 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151508 Sep 19 11:35:42.834666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 945/1857] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:42.848736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1a7256ce-76fb-4481-9653-a736db6fd11c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046618 Sep 19 11:35:42.849454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 913/1858] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:42.850886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:42.853052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:42.859016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.859527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.859964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.860655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:42.861107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:42.861533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:42.904317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-44b20b76-3845-43be-ae5f-76fbc1506fd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058217 Sep 19 11:35:42.904874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 946/1859] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:43.268346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:43.270482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:43.277453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.277930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.278367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.279046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.279526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.279945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.309062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-60789aad-0b24-4239-81d6-5d6e8dc234ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044633 Sep 19 11:35:43.309795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 914/1860] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:43.858136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:43.858736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:43.860852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:43.863034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:43.865324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.865808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.866239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.866928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.867405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.867827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.869003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.869487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.869924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.870622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.871078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.871539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.905792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c18d85e8-8e1d-4bd6-8403-2cf404ea3128 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047853 Sep 19 11:35:43.905792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 915/1861] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:43.916948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:43.926024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:43.932363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.933080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.933636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.934544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:43.935101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:43.935664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:43.967704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fcef3f07-63ae-496a-a50b-543786f71f04 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054479 Sep 19 11:35:43.968294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 916/1862] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:44.005687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:44.013809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cbda12d3-3f03-4a38-bb52-124b50d84e1b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159818 Sep 19 11:35:44.014385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 947/1863] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:44.322013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:44.324456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:44.330744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:44.331251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:44.331686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:44.332363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:44.332808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:44.333224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:44.362923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0de6e254-e549-47a5-a0ca-17063e810291 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044944 Sep 19 11:35:44.363494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 917/1864] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:44.917927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:44.920077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:44.926405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:44.926876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:44.927845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:44.928530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:44.928970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:44.929389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:44.958874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e50f927e-422d-46c2-bd5d-ccd56dc2d653 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045018 Sep 19 11:35:44.959548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 948/1865] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:44.980253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:44.982400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:44.988425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:44.988908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:44.989342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:44.990524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:44.990979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:44.991434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:45.020282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-df93f72f-9400-49f2-8c1c-4eba40f1779f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Sep 19 11:35:45.020833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 918/1866] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:45.037168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:45.037806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:45.043729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:45.044200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:45.044627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:45.045303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:45.045750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:45.046169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:45.174583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:45.182899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-03d751cb-ae0e-4531-93c1-f67bd8f84b37 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.149499 Sep 19 11:35:45.183492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 949/1867] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:45.375741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:45.378061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:45.384540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:45.385027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:45.385465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:45.386156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:45.386612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:45.387037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:45.417046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a46c54d4-02e5-441b-a49d-ba133303fc72 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045283 Sep 19 11:35:45.417619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 919/1868] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:45.971970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:45.974803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:45.981330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:45.981821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:45.982249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:45.982939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:45.983428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:45.983864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:46.013185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-94323e2c-2f25-41de-9360-0c52c41aee13 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 Sep 19 11:35:46.013746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 950/1869] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:46.032729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:46.034884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:46.040957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:46.041438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:46.041871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:46.042557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:46.043008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:46.043458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:46.072373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1dcfb877-eecc-4b26-9082-011211d7215f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Sep 19 11:35:46.073191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 920/1870] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:46.207064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:46.207697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:46.214267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:46.214956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:46.215747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:46.216701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:46.217061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:46.217545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:46.235416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:46.346039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:46.353851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8afcfeec-dffb-4e73-a2f1-8acf35e179ec tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150673 Sep 19 11:35:46.354421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 951/1871] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:46.430182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:46.432381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:46.438730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:46.439249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:46.439695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:46.440389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:46.440847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:46.441274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:46.471508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c8610eca-660c-47f4-a3c3-5b3c6416c65c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045778 Sep 19 11:35:46.472068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 921/1872] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:47.026027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:47.028200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:47.034742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.035250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.035687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.036877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.037333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.037803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.067589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d9ffa20-a88d-41a7-a8ce-84e8bc7181c0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Sep 19 11:35:47.068149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 952/1873] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:47.084787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:47.087075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:47.093048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.093527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.093965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.094650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.095102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.095552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.126130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cf29e8ec-dcda-4054-b22f-eec68890c6e9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045343 Sep 19 11:35:47.126736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 922/1874] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:47.377053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:47.377607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:47.383658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.384145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.384584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.385271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.385759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.386189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.484240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:47.486491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:47.492972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.493551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.494062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.494763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:47.495236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:47.495662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:47.521644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:47.527161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-17746f40-aa6d-477a-9f5c-7bfc1f6f9aae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047055 Sep 19 11:35:47.527751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 923/1875] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:47.529508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-37f678ee-61af-4f0c-b3b3-c9c24b1a4273 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.156392 Sep 19 11:35:47.530074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 953/1876] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:48.080261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:48.082405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:48.088372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.088942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.089316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.090010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.090467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.090899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.120972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-35a8802b-ef07-414c-baaa-3a929483ea86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044661 Sep 19 11:35:48.121543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 924/1877] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:48.139324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:48.141530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:48.148087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.148566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.149001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.149690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.150144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.150574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.181006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a6906e6e-608e-4ffd-9943-f00cb26815f2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045615 Sep 19 11:35:48.181563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 954/1878] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:48.540409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:48.542601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:48.544960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:48.549836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.550319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.550757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.551487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.552582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.553028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.554256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:48.554873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:48.561173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.561662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.562101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.562809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:48.563297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:48.563731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:48.585255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c5ce948d-4180-4b8f-afc3-9c0be87618ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049350 Sep 19 11:35:48.586015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 925/1879] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:48.693833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:48.701919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-162dff1f-8240-4e66-a1f1-006ca2c16457 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152297 Sep 19 11:35:48.702489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 955/1880] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:48 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:49.133059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:49.135289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:49.141389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.141868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.142307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.143026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.143512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.143935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.173814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-57ee2652-4771-4458-80bc-651bc81994b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044771 Sep 19 11:35:49.174633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 926/1881] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:49.192802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:49.195503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:49.202165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.202647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.203084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.203802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.204260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.204686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.233720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-97f73304-3ed0-4976-9530-7c31f3e2af19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044839 Sep 19 11:35:49.234280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 956/1882] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:49.599661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:49.601943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:49.610828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.611723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.612504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.613697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.614492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.615190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.646705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42ca6fe5-7e22-4e83-9fe8-e69268f88f58 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051133 Sep 19 11:35:49.647312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 927/1883] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:49.725608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:49.726745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:49.732726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.733211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.733648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.734332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:49.734791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:49.735244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:49.868684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:49.876458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-11a3c31a-c952-4aef-b55e-7365ad707c66 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154762 Sep 19 11:35:49.877026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 957/1884] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:50.185750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:50.187924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:50.193989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.194591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.195087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:50.195812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.196278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.196707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:50.221848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:50.227119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ad3ef79b-9ff7-49f0-98b3-02b78fff193d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Sep 19 11:35:50.227700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 928/1885] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:50.246241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:50.248428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:50.254812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.255329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.255770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:50.256470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.256924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.257411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:50.287087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45f00aae-5733-4d5d-b720-2c1cf2060aef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044906 Sep 19 11:35:50.287687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 958/1886] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:50.659848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:50.662009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:50.668616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.669102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.669539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:50.670238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.670696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.671125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:50.701010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bba9d5e4-7af1-42df-99e5-d6bd4d914cce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045629 Sep 19 11:35:50.701575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 929/1887] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:50.899494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:50.900109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:50.906279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.906758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.907223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:50.907920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:50.908375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:50.908802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:51.050018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:51.058308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-58686eeb-1d8f-4ad7-b203-707034d4039a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.162725 Sep 19 11:35:51.058868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 959/1888] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:51.240200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:51.242693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:51.248942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:51.249428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:51.249869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:51.250572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:51.251034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:51.251504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:51.281717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-20d2b934-f933-4adc-9670-846391ab561e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Sep 19 11:35:51.282290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 930/1889] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:51.299577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:51.301732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:51.309456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:51.309949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:51.310390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:51.311087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:51.311591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:51.312018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:51.341747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-575bd655-fcab-4eff-ae24-d5416445d050 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046143 Sep 19 11:35:51.342319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 960/1890] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:51.716206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:51.716708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:51.723542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:51.724040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:51.724481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:51.725193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:51.725652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:51.726678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:51.757800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-60eb18d0-fb07-462f-a370-87b09a0ef72a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047944 Sep 19 11:35:51.758375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 931/1891] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:52.082305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:52.082920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:52.089601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.090082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.090524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.091232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.091691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.092117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.227455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:52.236330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-87958326-702d-41df-b5ee-4227f2f3fcaa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.157905 Sep 19 11:35:52.236904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 961/1892] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:52.294518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:52.296755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:52.302773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.303290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.303810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.304522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.304983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.305410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.338084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-136e3230-2fd1-4f4f-93d5-7d7dea460c66 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047525 Sep 19 11:35:52.338681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 932/1893] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:52.354094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:52.356432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:52.363145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.363674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.364121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.364835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.365298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.365724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.400497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7332bd9a-d26e-4d22-b1c1-03b2620558fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050378 Sep 19 11:35:52.401074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 962/1894] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:52.770856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:52.773136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:52.779621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.780133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.780576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.781270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:52.781726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:52.782155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:52.812372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-56530d1b-4421-4ea2-bd38-8895ec517881 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045571 Sep 19 11:35:52.812935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 933/1895] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:53.259694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:53.260332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:53.266446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.266809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.267268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.267965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.268411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.268827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.351579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:53.354919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:53.361646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.362138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.362575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.363404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.363853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.364272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.397533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7e752ff8-5180-4c92-af07-dfd97c74429a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047789 Sep 19 11:35:53.397533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 934/1896] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:53.413180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:53.416013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:53.416515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:53.422235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.422722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.423160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.423859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c351f834-09a2-4d71-9f33-1f882059023a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.168062 Sep 19 11:35:53.423989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.424324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.424449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 963/1897] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:53.424749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.454804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-58de6fff-006d-4f82-a961-54b477ab2a28 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045766 Sep 19 11:35:53.455396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 935/1898] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:53.826020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:53.828221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:53.834080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.834560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.834998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.836266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:53.836720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:53.837140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:53.866055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1b6d8914-6a1d-4d4b-a13a-34bedb852168 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044249 Sep 19 11:35:53.868480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 964/1899] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:54.407534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:54.409615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:54.416169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.416654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.417094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.417794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.418249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.418674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.446309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:54.446925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:54.448805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-321fb8d6-0de1-4b54-a2ef-2288dfcc61ba tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045357 Sep 19 11:35:54.449375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 936/1900] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:54.453657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.454145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.454585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.455339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.455802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.456231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.467323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:54.469469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:54.476062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.476543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.476979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.477755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.478125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.478549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.508602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9552a0d1-5f96-4ebd-a559-6fdd06c7f2f1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045104 Sep 19 11:35:54.509170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 937/1901] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:35:54.593658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:54.601645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d707c65e-eeb8-47ef-90cd-4d3bb4507ea3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159666 Sep 19 11:35:54.602230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 965/1902] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:35:54.878775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:54.880949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:54.887504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.887991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.888452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.889140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:54.889595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:54.890024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:54.920553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5cae0051-d495-416c-abf6-108545d0be9b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045817 Sep 19 11:35:54.921133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 938/1903] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:55.461442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:55.463576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:55.470041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.470527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.470969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.471706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.472155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.472571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.502767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4183dd49-f1cd-47b1-8ab3-9abefe8c8227 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045867 Sep 19 11:35:55.503347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 966/1904] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:55.520982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:55.523696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:55.530243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.530727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.531196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.532166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.532329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.533342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.563515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1ad8619f-19b8-4c7c-af03-de53446cbba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046424 Sep 19 11:35:55.564099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 939/1905] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:55.625533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:55.626143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:55.632140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.632613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.633050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.633736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.634185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.634607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.766872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:55.775411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b1fa576d-75eb-4e22-a2e8-bad6bce1c217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153677 Sep 19 11:35:55.775968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 967/1906] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:55.933426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:55.935602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:55.941640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.942132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.942572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.943293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:55.943756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:55.944188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:55.975654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3d0530c3-4c6b-4324-b6f0-b9682d8d7bbf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046196 Sep 19 11:35:55.976149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 940/1907] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:35:56.515495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:56.517674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:56.524092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.524573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.525016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:56.525706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.526165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.526589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:56.530252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:56.558457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e3159ff0-3aac-473f-a839-9ac4cba50345 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046963 Sep 19 11:35:56.559017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 968/1908] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:56.576296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:56.578584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:56.585084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.585561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.586000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:56.586686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.587136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.587590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:56.619444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0ea3d640-d87d-419d-b873-81f3a5f54a14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047306 Sep 19 11:35:56.620013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 941/1909] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:56.798428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:56.798981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:56.805654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.806138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.806576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:56.807310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.807771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.808203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:56.940132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:56.948563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4b5e8712-6e0a-4318-bb09-8824c83b738a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154427 Sep 19 11:35:56.949142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 969/1910] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:56.987459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:56.989691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:56.995905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.996402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.996899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:56.997598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:56.998055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:56.998484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:57.030557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-472e327f-730b-4311-b179-946a59431b89 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046976 Sep 19 11:35:57.031192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 942/1911] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:57.571726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:57.574116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:57.576446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:57.581064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:57.581538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:57.581965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:57.582648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:57.583098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:57.583541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:57.613763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d0e75fc1-8207-4ba0-b74c-dd5d530a2882 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046577 Sep 19 11:35:57.614387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 970/1912] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:57.632884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:57.635052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:57.641605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:57.642088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:57.642526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:57.643242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:57.643702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:57.644128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:57.673183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30ad4f9b-1988-450f-a1b0-841c11c78c76 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044920 Sep 19 11:35:57.673745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 943/1913] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:57.972863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:57.973413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:57.980036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:57.980505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:57.980932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:57.981612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:57.982062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:57.982505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:58.045375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:58.047580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:58.053746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:58.054762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:58.055215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:58.056032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:58.056480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:58.056903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:58.088043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0e6c464d-801a-4326-a8d7-431e9aa021c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046732 Sep 19 11:35:58.088624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 944/1914] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:58.119778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:58.127557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f35b536b-0d24-411e-b984-0a55b2915736 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.158715 Sep 19 11:35:58.128121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 971/1915] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:58.626283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:58.628492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:58.634583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:58.635186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:58.635523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:58.636233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:58.636687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:58.637118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:58.654492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:35:58.667890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3e3ea8eb-56da-473c-ad94-2660f4cdc034 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045569 Sep 19 11:35:58.671033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 945/1916] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:58.685578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:58.687855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:58.694935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:58.695455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:58.695894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:58.696612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:58.697068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:58.697759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:58.726848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-18ad1271-fecf-4f6e-ba2f-d376b1e1dcf5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045224 Sep 19 11:35:58.727445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 972/1917] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:59.100787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:59.102948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:59.109645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.110165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.110607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.111341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.111798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.112223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.143420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d9c7c6f2-bab6-4987-bc64-afcc623b38d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046615 Sep 19 11:35:59.143978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 946/1918] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:35:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:35:59.150219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:59.150861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:59.156850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.157336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.157772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.158465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.158921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.159385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.292777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:35:59.300754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-55097e25-5921-4970-927b-0c2da8893cd2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154366 Sep 19 11:35:59.301326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 973/1919] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:35:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:35:59.681147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:59.684107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:59.690688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.691193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.691675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.692402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.692859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.693284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.725206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-af061a23-ac0d-499b-a281-8f2630df4373 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048170 Sep 19 11:35:59.726544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 947/1920] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:35:59.739495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:35:59.741695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:35:59.748070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.748561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.749001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.749696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:35:59.750154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:35:59.750583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:35:59.780312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aca674d4-2655-4efc-aa59-65997f6f516b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044827 Sep 19 11:35:59.780871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 974/1921] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:35:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:00.156322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:00.158464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:00.165059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.165542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.165980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.166664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.167113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.167565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.196648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a3a85929-bf20-4e82-8d7b-829d3d2f47f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044281 Sep 19 11:36:00.197199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 948/1922] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:00.325395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:00.325999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:00.332013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.332497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.332939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.333635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.334102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.334537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.466582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:00.474384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-11fda059-6207-4282-8b7d-52b864e5da0e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153179 Sep 19 11:36:00.474961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 975/1923] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:00.737865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:00.739962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:00.746300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.746781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.747243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.747933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.748384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.748809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.778562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ea28fd0d-4411-4699-ab73-23633fc31796 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044797 Sep 19 11:36:00.779112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 949/1924] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:00.793345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:00.795526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:00.801890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.802461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.802904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.803658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:00.804113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:00.804541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:00.833584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-554b058d-281c-4da4-bad0-c81af3de31ea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044719 Sep 19 11:36:00.834137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 976/1925] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:01.209321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:01.212124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:01.217997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.220858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.220858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.220858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.220858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.221273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.249231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6449954a-023b-4602-b63c-dd0766ebb74a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043880 Sep 19 11:36:01.249784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 950/1926] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:01.498084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:01.498703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:01.504652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.505137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.505571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.506256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.506714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.507745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.642087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:01.649879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c0f5dd21-a4ee-470c-966d-5451b8aa3dcb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155713 Sep 19 11:36:01.650441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 977/1927] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:36:01.792114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:01.794191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:01.800920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.801401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.801827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.802539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.802991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.803440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.834788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-457dcb5c-2bbe-4204-860f-9b4e85107044 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047225 Sep 19 11:36:01.835384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 951/1928] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:01.846017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:01.848374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:01.855425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.855999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.856512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.857290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:01.857818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:01.858315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:01.888745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4af1ba27-63c5-4a83-befc-c4030c34edb2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046631 Sep 19 11:36:01.889326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 978/1929] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:02.262071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:02.264331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:02.270276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.270759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.271225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.271919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.272543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.272971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.304871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9132b92c-8d86-4bb9-bea6-2abc3cbb9d55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046686 Sep 19 11:36:02.305708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 952/1930] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:36:02.673376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:02.673903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:02.679978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.680460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.680905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.681589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.682048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.682486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.813145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:02.821627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-97cd434b-6f47-4e83-a748-04ebba61d068 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.151575 Sep 19 11:36:02.822201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 979/1931] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:02.847079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:02.849285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:02.855686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.856170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.856603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.857297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.857749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.858174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.900977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:02.903129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:02.909525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.910007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.910444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.911133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:02.911611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:02.912033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:02.942984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9240a6ef-ec69-4af2-a4e6-1e432ec5d550 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045869 Sep 19 11:36:02.943710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 980/1932] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:36:02.945465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-92625319-afc6-4837-9024-6c391a0c9513 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/action" status: 200 len: 76425 microversion: 2.1 time: 0.102007 Sep 19 11:36:02.946716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 953/1933] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:36:02 2022] POST /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84/action => generated 76425 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:03.317842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:03.320009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:03.326271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.326751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.327204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.327890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.328341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.328767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.366929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5213b948-d9b2-430f-8ee8-c2a05b46734c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053061 Sep 19 11:36:03.367530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 981/1934] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:03.845822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:03.846517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:03.854154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.854753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.855078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.855776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.856231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.856651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.956233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:03.958502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:03.966691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.967336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.967849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.968585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:03.969043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:03.969470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:03.994383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:04.002265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aaaba2bf-2b85-4016-8271-77e966779c6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.160789 Sep 19 11:36:04.002490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ee9ecbd8-f03e-47d8-b3d0-67c5eba64315 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050044 Sep 19 11:36:04.009254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 982/1935] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:36:04.011541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 954/1936] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:04.378925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:04.381114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:04.388122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:04.388611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:04.389048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:04.389744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:04.390397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:04.390844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:04.421425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8e5765c6-009a-4d7e-9328-8758722060c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046383 Sep 19 11:36:04.422182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 983/1937] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:05.016610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:05.018738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:05.025824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.026159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:05.026576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.026737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.026850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:05.027426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.027873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.028298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.032713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.033230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.033640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.034342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.034801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.035255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.060337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1e1db27f-fb7d-4a0d-a8ef-f01190d95010 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047675 Sep 19 11:36:05.060927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 955/1938] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:05.168795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:05.172273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:05.176840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d9638b97-fce3-49d9-9fd5-2c05c25ad1bd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154997 Sep 19 11:36:05.177407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 984/1939] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:36:05.434934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:05.437016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:05.443468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.443947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.444381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.445069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:05.445651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:05.446076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:05.475348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-769d064b-7c9a-44ce-b472-d29cbf5cfb7c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045100 Sep 19 11:36:05.475905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 956/1940] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:06.079383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:06.081594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:06.088603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.089092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.089529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.090220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.090678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.091102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.120810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4f28530e-41d1-40e1-9337-b2c686ebb322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045527 Sep 19 11:36:06.121382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 985/1941] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:06.200201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:06.200800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:06.207154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.207657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.208115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.208793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.209246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.209675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.343337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:06.351095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-26ee97e3-4bb1-4236-922c-c019a7a364eb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155008 Sep 19 11:36:06.351695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 957/1942] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:06.488085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:06.490236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:06.496820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.497302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.497742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.498432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:06.498888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:06.499345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:06.529017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c1997108-a46b-4e74-855c-0ad29fee5185 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044897 Sep 19 11:36:06.529575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 986/1943] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:07.133041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:07.135743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:07.141776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:07.142259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:07.142698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:07.143426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:07.143881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:07.144304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:07.175266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-10a04abf-c63f-432d-90cd-68ec826a6d00 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046613 Sep 19 11:36:07.175816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 958/1944] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:07.374809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:07.375374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:07.381832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:07.382297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:07.382733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:07.384096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:07.384550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:07.384975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:07.517066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:07.524720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ead6ffcb-2506-4911-9863-16bd07b5e518 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.153891 Sep 19 11:36:07.525282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 987/1945] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:07.541596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:07.543829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:07.550157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:07.550644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:07.551082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:07.551800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:07.552256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:07.552678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:07.582895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-863ca6f3-22eb-426a-8308-380d453b6235 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045349 Sep 19 11:36:07.583491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 959/1946] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:08.186974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:08.189132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:08.195395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:08.195886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:08.196331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:08.197035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:08.197750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:08.198241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:08.229367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6b3afc1a-456b-4f54-a38a-53090ac292f8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046319 Sep 19 11:36:08.229958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 988/1947] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:08.547714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:08.548340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:08.554758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:08.555838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:08.556327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:08.557055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:08.557501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:08.557919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:08.595579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:08.597867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:08.605161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:08.605645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:08.606080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:08.606819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:08.607330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:08.607758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:08.638377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6372c48f-83a3-42bd-9454-113a7722a25f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046796 Sep 19 11:36:08.638953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 989/1948] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:08.691377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:08.699658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-987f7963-1520-4adf-acd4-f1b9c1aca0e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.155842 Sep 19 11:36:08.700225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 960/1949] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:09.242003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:09.244246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:09.250291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:09.250776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:09.251244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:09.251938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:09.252392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:09.252818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:09.282388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-457782bf-9105-4cfd-a1fb-ba463a5377b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044367 Sep 19 11:36:09.282942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 990/1950] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 11:36:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:36:09.650360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:09.652519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:09.659005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:09.659506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:09.659938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:09.660622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:09.661070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:09.661488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:09.691282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f3d881bc-cd1f-48af-85e0-03db498ef4f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044929 Sep 19 11:36:09.691843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 961/1951] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:09.722454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:09.723066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:09.730276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:09.730761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:09.731235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:09.731928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:09.732392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:09.732819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:09.863280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:09.870921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-15dafbcc-5a89-494b-96b1-ef6192b46d04 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.152355 Sep 19 11:36:09.871528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 991/1952] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:36:10.295117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:36:10.297354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:10.303411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.303899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.304371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:10.305587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.306042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.306534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:10.324186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:10.381500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fd1df824-230b-41ac-b23b-3759c61a9d97 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action" status: 200 len: 82213 microversion: 2.1 time: 0.090020 Sep 19 11:36:10.382082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 962/1953] 10.222.0.78 () {60 vars in 1278 bytes} [Mon Sep 19 11:36:10 2022] POST /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/action => generated 82213 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:36:10.396467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:10.397072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:10.403774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.404297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.404737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:10.405453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.405895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.406322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:10.705327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:10.707510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:10.714667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.715193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.715637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:10.716346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.716793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.717211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:10.748531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e0184256-d6ac-4789-87d1-3a1a4d2c4fce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047654 Sep 19 11:36:10.749105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 963/1954] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:36:10.893390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:10.893997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:10.900369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.900843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.901276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:10.901954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:10.902404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:10.902821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:11.035772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:11.044285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30e4ed52-6536-4408-9694-20564f76a4f6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.154788 Sep 19 11:36:11.044853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 964/1955] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:36:11.764369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:11.766586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:11.773040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:11.773553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:11.774496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:11.775215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:11.775713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:11.776190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:11.806030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d2dc004a-b42b-4506-b492-80b2ecf90686 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045602 Sep 19 11:36:11.806596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 965/1956] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:36:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:36:12.067705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:12.068203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:12.074812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:12.075328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:12.075769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:12.076460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:12.076919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:12.077342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:12.215538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:36:12.223416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cfa1a1b3-0f7f-4168-aa56-9a4921fb7114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.159773 Sep 19 11:36:12.223989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 966/1957] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:36:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:36:12.502377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:36:12.502858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:36:12.510294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:12.510829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:12.511450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:12.512180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:36:12.512671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:36:12.513098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:36:12.584757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lazy-loading 'services' on Instance uuid 416dd466-0154-4d9a-af4a-9f87010ce3a3 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:36:20.400406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=45 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:22.506985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=85 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:22.532223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=28 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:36:22.589322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=50 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:03.816422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:37:03.817156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:37:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 (ip 10.222.0.78) !!! Sep 19 11:37:12.552422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'services' on Instance uuid 95347db7-c8c7-4731-8d6c-32d6fec8d721 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:37:12.649546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Request method failure captured: Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 HTTP/1.1 Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFH72Y9bjl7MP5if3oS2_xIfecpiliN7jiHG1UX1MmtcNca6s-RPmb0R1tDf-QL6MBUZwFgWInXH_MeVWr2kAk-xSf4B5IuP1284HiQqMQro-i2IURqPW8dw3mIj6NuevA74FHmYA253GoMFvl4TuJGERPzy00IaVvLMuVcXKRqeLEA Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:37:12.651954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 28638075e935490bb7c8c229de9d14c5 Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:37:12.653403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '416dd466-0154-4d9a-af4a-9f87010ce3a3', 'id': 'be5435fb-bdcd-4d0e-978c-884b5aa32128'} Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:37:12.654318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:37:12.655538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:37:12.656751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:37:12.657814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) Sep 19 11:37:12.658974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:37:12.660209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-2623a622-60e8-428c-b25a-d806df566688) {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:37:12.660209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6b59f6d5-dae7-4fec-8e7c-e57fa7dbe3a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128" status: 400 len: 269 microversion: 2.1 time: 62.261093 Sep 19 11:37:12.660209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 992/1958] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:36:10 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 => generated 269 bytes in 62262 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:37:12.730815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:12.733194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:12.741373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:12.741861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:12.742296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:12.743593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:12.744053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:12.744481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:12.773933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3cc2447f-a78e-4e1c-8fa5-f19928a50a44 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.118755 Sep 19 11:37:12.774540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 993/1959] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 11:37:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:37:12.778972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:12.779601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:12.785188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:12.785675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:12.786116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:12.786804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:12.787300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:12.787728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:12.918454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:37:12.926259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b0a29d99-648c-45a8-a992-25fcb0d659d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1569 microversion: 2.1 time: 0.150767 Sep 19 11:37:12.926834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 994/1960] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:37:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:37:12.931459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:37:12.931948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:37:12.937836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:12.938315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:12.938745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:12.939475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:37:12.939927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:37:12.940353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:37:22.557763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:22.936041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:37:22.959555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=16 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:12.843716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lazy-loading 'services' on Instance uuid 416dd466-0154-4d9a-af4a-9f87010ce3a3 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:38:12.895592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-52426dd9-ba72-4128-9af9-99930766884f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b" status: 202 len: 0 microversion: 2.1 time: 120.396906 Sep 19 11:38:12.896588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 967/1961] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:36:12 2022] DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b => generated 0 bytes in 120399 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:38:12.902647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:38:12.904123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:38:12.910386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:12.911063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:12.911692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:12.912393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:38:12.912841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:38:12.913263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:38:22.847848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:22.907600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:22.937979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=5,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:38:27.352787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:38:27.353394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:38:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b (ip 10.222.0.78) !!! Sep 19 11:38:29.543370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:38:29.543995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:38:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 (ip 10.222.0.78) !!! Sep 19 11:38:31.157368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:38:31.157998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:38:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 (ip 10.222.0.78) !!! Sep 19 11:38:47.362885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:38:47.363411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:38:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b (ip 10.222.0.78) !!! Sep 19 11:39:12.794191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Request method failure captured: Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 HTTP/1.1 Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFH72Y9bjl7MP5if3oS2_xIfecpiliN7jiHG1UX1MmtcNca6s-RPmb0R1tDf-QL6MBUZwFgWInXH_MeVWr2kAk-xSf4B5IuP1284HiQqMQro-i2IURqPW8dw3mIj6NuevA74FHmYA253GoMFvl4TuJGERPzy00IaVvLMuVcXKRqeLEA Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:39:12.796437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 28638075e935490bb7c8c229de9d14c5 Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:39:12.797995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '416dd466-0154-4d9a-af4a-9f87010ce3a3', 'id': 'be5435fb-bdcd-4d0e-978c-884b5aa32128'} Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:39:12.798897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:39:12.800072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:12.801986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:39:12.803118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) Sep 19 11:39:12.804647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:39:12.805989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0858cd56-f57c-4711-af49-dc38e1569171) {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:39:12.805989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-272b6883-a026-4b4b-9fb3-4358ab821792 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128" status: 400 len: 269 microversion: 2.1 time: 119.870102 Sep 19 11:39:12.805989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 995/1962] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:37:12 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 => generated 269 bytes in 119871 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:39:12.805989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:12.806352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:12.811249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:12.811743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:12.812189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:12.812890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:12.813349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:12.813782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:12.839148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:39:12.846128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'services' on Instance uuid 95347db7-c8c7-4731-8d6c-32d6fec8d721 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:39:13.100649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7573f64e-c53f-4ef8-85f8-464b8ca91746 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 204 len: 0 microversion: 2.1 time: 0.300967 Sep 19 11:39:13.101258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 996/1963] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:39:12 2022] DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:39:13.106570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:39:13.110577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:13.118812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.119662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.119797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.120452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.120903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.121320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.269602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a83e47cb-fc8b-490c-918d-1a314f71d052 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/action" status: 200 len: 38019 microversion: 2.20 time: 0.166817 Sep 19 11:39:13.270783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 997/1964] 10.222.0.78 () {62 vars in 1319 bytes} [Mon Sep 19 11:39:13 2022] POST /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c/action => generated 38019 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:39:13.275778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:13.276352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:13.283184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.283674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.284100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.284784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.285481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.286123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.311726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:39:13.546360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-81b27af0-f40a-4b99-94c3-6aa218f23788 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 204 len: 0 microversion: 2.1 time: 0.274050 Sep 19 11:39:13.546868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 998/1965] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:39:13 2022] DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 0 bytes in 276 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:39:13.627547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-78d77702-4f47-4914-a300-fa1b8f4aa920 req-149d6473-fb8c-4306-b4f3-6f433c914c1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba241cb3-089a-4eef-a681-bddf2cb387bd", "tag": "96003a8a-4fc4-452c-bf1a-dded308d6faa"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:39:13.639390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-78d77702-4f47-4914-a300-fa1b8f4aa920 req-149d6473-fb8c-4306-b4f3-6f433c914c1d service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.640359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-78d77702-4f47-4914-a300-fa1b8f4aa920 req-149d6473-fb8c-4306-b4f3-6f433c914c1d service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.640359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-78d77702-4f47-4914-a300-fa1b8f4aa920 req-149d6473-fb8c-4306-b4f3-6f433c914c1d service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.652057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-78d77702-4f47-4914-a300-fa1b8f4aa920 req-149d6473-fb8c-4306-b4f3-6f433c914c1d service nova] Creating event network-changed:96003a8a-4fc4-452c-bf1a-dded308d6faa for instance ba241cb3-089a-4eef-a681-bddf2cb387bd on hv-cinder-82282 Sep 19 11:39:13.657153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-78d77702-4f47-4914-a300-fa1b8f4aa920 req-149d6473-fb8c-4306-b4f3-6f433c914c1d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.108891 Sep 19 11:39:13.657851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 999/1966] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:39:13.663643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:39:13.664228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:39:13.670877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.674589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.674589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:13.674589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:39:13.674589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:39:13.675019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:39:22.852279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:39:23.668395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:39:23.697213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:13.161238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Request method failure captured: Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b HTTP/1.1 Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFJEoOTjbJZCDcv9fChyLvfI4r1btyoXxi7aDQqBzkdtgLFcF1bJMaXZlknsz7voW2FeT5gvj5PqtSU9_bRqMLlQ3BNnaznGYvDzRqZS0SvzOYYkylN17blyvdJsePZIWp3WL8Ezhoc3Cb5uGuznN_eVN3GlgpcWQv_ueuvTybvotHY Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:40:13.163703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4682f63b56d24450b2605b5b4c2129d9 Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:40:13.165273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'server_id': '95347db7-c8c7-4731-8d6c-32d6fec8d721', 'id': 'ed5634c5-3a81-4fb1-9737-86409b2a798b'} Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:40:13.166208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:40:13.167451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.168663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.170384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) Sep 19 11:40:13.172825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.175082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-6aa5f040-a2c2-42cc-9b59-a84d17980a8e) {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:40:13.175082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c751d1d0-339e-4f32-b176-28460b70a229 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b" status: 400 len: 269 microversion: 2.1 time: 120.267612 Sep 19 11:40:13.175082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 968/1967] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:38:12 2022] DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b => generated 269 bytes in 120269 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:40:13.175082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:40:13.175731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:40:13.179841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.180470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.180770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.181483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.181943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.182372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.211877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lazy-loading 'services' on Instance uuid 416dd466-0154-4d9a-af4a-9f87010ce3a3 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:40:13.449339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'services' on Instance uuid 95347db7-c8c7-4731-8d6c-32d6fec8d721 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:40:13.478825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Request method failure captured: Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 HTTP/1.1 Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFH72Y9bjl7MP5if3oS2_xIfecpiliN7jiHG1UX1MmtcNca6s-RPmb0R1tDf-QL6MBUZwFgWInXH_MeVWr2kAk-xSf4B5IuP1284HiQqMQro-i2IURqPW8dw3mIj6NuevA74FHmYA253GoMFvl4TuJGERPzy00IaVvLMuVcXKRqeLEA Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:40:13.481415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 28638075e935490bb7c8c229de9d14c5 Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:40:13.482875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '416dd466-0154-4d9a-af4a-9f87010ce3a3', 'id': 'be5435fb-bdcd-4d0e-978c-884b5aa32128'} Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:40:13.483833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:40:13.484929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.486110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.487146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) Sep 19 11:40:13.488437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.489527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-c2f895e1-11e8-4d23-b25d-535e5479976f) {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:40:13.489527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a54e96cd-5049-4d03-bd44-115a7e35b2fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128" status: 400 len: 269 microversion: 2.1 time: 59.824027 Sep 19 11:40:13.489527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1000/1968] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:39:13 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 => generated 269 bytes in 59825 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:40:13.514889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Request method failure captured: Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b HTTP/1.1 Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFJEoOTjbJZCDcv9fChyLvfI4r1btyoXxi7aDQqBzkdtgLFcF1bJMaXZlknsz7voW2FeT5gvj5PqtSU9_bRqMLlQ3BNnaznGYvDzRqZS0SvzOYYkylN17blyvdJsePZIWp3WL8Ezhoc3Cb5uGuznN_eVN3GlgpcWQv_ueuvTybvotHY Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:40:13.517131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4682f63b56d24450b2605b5b4c2129d9 Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:40:13.518913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'server_id': '95347db7-c8c7-4731-8d6c-32d6fec8d721', 'id': 'ed5634c5-3a81-4fb1-9737-86409b2a798b'} Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:40:13.520174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:40:13.521579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.524568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.525863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) Sep 19 11:40:13.528063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.529690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-91278ac1-6ed4-463a-ba1d-27a4327fceb6) {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:40:13.529690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-93495b68-5fb9-457c-ad89-82e1a059e93c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b" status: 400 len: 269 microversion: 2.1 time: 0.351970 Sep 19 11:40:13.529690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 969/1969] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:40:13 2022] DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b => generated 269 bytes in 353 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:40:13.529690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:40:13.530106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:40:13.531021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.531562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.532036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.532704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.533158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.533589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.561780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:40:13.618054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:40:13.618554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:40:13.626593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.627081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.627636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.628343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.628800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.629229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.643763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 HTTP/1.1 Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:40:13.652444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:40:13.654127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '908c5502-74d2-42f5-bd69-d99ade535859'} Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:40:13.654927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:40:13.656263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:40:13.657546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:40:13.657546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e1059384-704c-41fb-91d6-6bcbb33dd378 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 404 len: 111 microversion: 2.1 time: 0.161949 Sep 19 11:40:13.657546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1001/1970] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:40:13 2022] DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 111 bytes in 163 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:40:13.657546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:40:13.657546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:40:13.658639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.659105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.659579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.660279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.660739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.661170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.692072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.compute.api [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Instance is already in deleting state, ignoring this request Sep 19 11:40:13.692908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-adb7d6e2-2591-4508-a467-fc1f36c264cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 204 len: 0 microversion: 2.1 time: 0.172611 Sep 19 11:40:13.693541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 970/1971] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:40:13 2022] DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:40:13.698445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:40:13.698945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:40:13.705465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.705954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.706397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:13.707096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:40:13.707586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:40:13.708015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:40:23.656380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:23.680689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=10 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:23.703437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:40:23.726754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:13.123134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lazy-loading 'services' on Instance uuid 416dd466-0154-4d9a-af4a-9f87010ce3a3 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:41:13.173871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'services' on Instance uuid 95347db7-c8c7-4731-8d6c-32d6fec8d721 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:41:13.304861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Request method failure captured: Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 HTTP/1.1 Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFH72Y9bjl7MP5if3oS2_xIfecpiliN7jiHG1UX1MmtcNca6s-RPmb0R1tDf-QL6MBUZwFgWInXH_MeVWr2kAk-xSf4B5IuP1284HiQqMQro-i2IURqPW8dw3mIj6NuevA74FHmYA253GoMFvl4TuJGERPzy00IaVvLMuVcXKRqeLEA Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:41:13.308916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 28638075e935490bb7c8c229de9d14c5 Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:41:13.311000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '416dd466-0154-4d9a-af4a-9f87010ce3a3', 'id': 'be5435fb-bdcd-4d0e-978c-884b5aa32128'} Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.312820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.314321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.316264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.317547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) Sep 19 11:41:13.319544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.323420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-e9527d95-97e5-4f00-9a3e-7bdb0f72c485) {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:13.323420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-09e02705-7739-4222-8706-fbae6030cb0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128" status: 400 len: 269 microversion: 2.1 time: 59.673667 Sep 19 11:41:13.324189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1002/1972] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:40:13 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 => generated 269 bytes in 59676 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:41:13.329756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.330718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.340620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.340620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.340620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.340620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.341003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.341366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.348972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Request method failure captured: Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b HTTP/1.1 Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFJEoOTjbJZCDcv9fChyLvfI4r1btyoXxi7aDQqBzkdtgLFcF1bJMaXZlknsz7voW2FeT5gvj5PqtSU9_bRqMLlQ3BNnaznGYvDzRqZS0SvzOYYkylN17blyvdJsePZIWp3WL8Ezhoc3Cb5uGuznN_eVN3GlgpcWQv_ueuvTybvotHY Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:41:13.351583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4682f63b56d24450b2605b5b4c2129d9 Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:41:13.353023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'server_id': '95347db7-c8c7-4731-8d6c-32d6fec8d721', 'id': 'ed5634c5-3a81-4fb1-9737-86409b2a798b'} Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.353703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.355187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.356387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.357474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) Sep 19 11:41:13.359562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.360800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-fc20b6d7-cf25-47f6-adcd-0996555d4955) {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:13.360800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-be8dc1f7-39f8-4cae-9d3b-ece9e9c2ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b" status: 400 len: 269 microversion: 2.1 time: 59.658533 Sep 19 11:41:13.360800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 971/1973] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:40:13 2022] DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b => generated 269 bytes in 59659 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:41:13.361896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.362012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.362012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 HTTP/1.1 Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:41:13.362203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.366415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '908c5502-74d2-42f5-bd69-d99ade535859'} Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:13.367477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.372685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.375017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:13.375017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b83c7c66-2247-4b63-b0d1-675a5bbffdfa tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 404 len: 111 microversion: 2.1 time: 0.035219 Sep 19 11:41:13.375017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1003/1974] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:41:13.375365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.375365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.375365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.375365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.375752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.375752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.401994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:41:13.444550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-bda9497a-afa1-4e68-b0a9-72c3e1fccef5 req-8a0bdcd1-dc9f-4962-9710-d5a55f3411d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "908c5502-74d2-42f5-bd69-d99ade535859", "name": "network-vif-deleted", "tag": "627f1e13-4c39-42fa-ad5b-1f09b1a2ff71"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:41:13.457193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-bda9497a-afa1-4e68-b0a9-72c3e1fccef5 req-8a0bdcd1-dc9f-4962-9710-d5a55f3411d1 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.457986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-bda9497a-afa1-4e68-b0a9-72c3e1fccef5 req-8a0bdcd1-dc9f-4962-9710-d5a55f3411d1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.458442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-bda9497a-afa1-4e68-b0a9-72c3e1fccef5 req-8a0bdcd1-dc9f-4962-9710-d5a55f3411d1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.470218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-bda9497a-afa1-4e68-b0a9-72c3e1fccef5 req-8a0bdcd1-dc9f-4962-9710-d5a55f3411d1 service nova] Creating event network-vif-deleted:627f1e13-4c39-42fa-ad5b-1f09b1a2ff71 for instance 908c5502-74d2-42f5-bd69-d99ade535859 on hv-cinder-82282 Sep 19 11:41:13.476474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-bda9497a-afa1-4e68-b0a9-72c3e1fccef5 req-8a0bdcd1-dc9f-4962-9710-d5a55f3411d1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.113816 Sep 19 11:41:13.477082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1004/1975] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:41:13.484246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.484246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.490127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.490753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.491207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.492119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.492575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.493003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.513975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.compute.api [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Instance is already in deleting state, ignoring this request Sep 19 11:41:13.515181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a1bc31ff-ef93-43d6-ba89-f8083ef752f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 204 len: 0 microversion: 2.1 time: 0.160654 Sep 19 11:41:13.515901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 972/1976] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:13.521660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.522220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.528853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.529602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.530147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.533331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.533331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.533331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.588961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lazy-loading 'services' on Instance uuid 416dd466-0154-4d9a-af4a-9f87010ce3a3 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:41:13.648229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'services' on Instance uuid 95347db7-c8c7-4731-8d6c-32d6fec8d721 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:41:13.692973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Request method failure captured: Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 HTTP/1.1 Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFH72Y9bjl7MP5if3oS2_xIfecpiliN7jiHG1UX1MmtcNca6s-RPmb0R1tDf-QL6MBUZwFgWInXH_MeVWr2kAk-xSf4B5IuP1284HiQqMQro-i2IURqPW8dw3mIj6NuevA74FHmYA253GoMFvl4TuJGERPzy00IaVvLMuVcXKRqeLEA Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:41:13.695654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 28638075e935490bb7c8c229de9d14c5 Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:41:13.698046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '416dd466-0154-4d9a-af4a-9f87010ce3a3', 'id': 'be5435fb-bdcd-4d0e-978c-884b5aa32128'} Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.699341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.700710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.702616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.704487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) Sep 19 11:41:13.705848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.707671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-26d4c060-c74a-49c4-9072-f7e8d48bf001) {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:13.707671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-273b88a6-8fbe-4ded-b05c-81137b93959f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128" status: 400 len: 269 microversion: 2.1 time: 0.219609 Sep 19 11:41:13.707671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1005/1977] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 => generated 269 bytes in 222 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:41:13.707671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.711686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.715392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.717208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.717208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.727607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.728917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.730357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.737381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Request method failure captured: Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b HTTP/1.1 Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFJEoOTjbJZCDcv9fChyLvfI4r1btyoXxi7aDQqBzkdtgLFcF1bJMaXZlknsz7voW2FeT5gvj5PqtSU9_bRqMLlQ3BNnaznGYvDzRqZS0SvzOYYkylN17blyvdJsePZIWp3WL8Ezhoc3Cb5uGuznN_eVN3GlgpcWQv_ueuvTybvotHY Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:41:13.740338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 4682f63b56d24450b2605b5b4c2129d9 Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:41:13.742059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'server_id': '95347db7-c8c7-4731-8d6c-32d6fec8d721', 'id': 'ed5634c5-3a81-4fb1-9737-86409b2a798b'} Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.742822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.746296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.747842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.749078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) Sep 19 11:41:13.750390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.751911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-95cfd8af-53c3-433f-b1f8-b4091bc35f01) {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:13.751911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-027afedf-90b9-4932-b434-882ec61dbfc2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b" status: 400 len: 269 microversion: 2.1 time: 0.225651 Sep 19 11:41:13.751911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 973/1978] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b => generated 269 bytes in 227 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:41:13.753437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.754249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.766573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.767525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.767787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.768189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.769666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.770132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 HTTP/1.1 Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:41:13.770533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.771990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '908c5502-74d2-42f5-bd69-d99ade535859'} Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:13.772804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:13.774837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.777688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.777858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:13.777858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3ba786b1-f014-4a3d-85d7-30872342b27b tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 404 len: 111 microversion: 2.1 time: 0.071451 Sep 19 11:41:13.777858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1006/1979] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:41:13.818384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.818384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.818384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.818384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.819132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:41:13.819383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.819383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.819383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.819383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.899496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lazy-loading 'services' on Instance uuid 416dd466-0154-4d9a-af4a-9f87010ce3a3 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:41:13.961953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Request method failure captured: Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 HTTP/1.1 Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFH72Y9bjl7MP5if3oS2_xIfecpiliN7jiHG1UX1MmtcNca6s-RPmb0R1tDf-QL6MBUZwFgWInXH_MeVWr2kAk-xSf4B5IuP1284HiQqMQro-i2IURqPW8dw3mIj6NuevA74FHmYA253GoMFvl4TuJGERPzy00IaVvLMuVcXKRqeLEA Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:41:13.964361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/ec8ddabe0fd049de97da2f63453aabef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: ec8ddabe0fd049de97da2f63453aabef Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestMinimumBasicScenario-752154063 Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 28638075e935490bb7c8c229de9d14c5 Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestMinimumBasicScenario-752154063-project Sep 19 11:41:13.966057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '416dd466-0154-4d9a-af4a-9f87010ce3a3', 'id': 'be5435fb-bdcd-4d0e-978c-884b5aa32128'} Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.966799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:13.967899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.969152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.970189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) Sep 19 11:41:13.971580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:13.973365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-340ef876-7ee5-49eb-a06a-69d357df5c53) {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:13.973365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-20c31470-f20d-4bfd-9af8-613441420c88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128" status: 400 len: 269 microversion: 2.1 time: 0.188674 Sep 19 11:41:13.973365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1007/1980] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3/os-volume_attachments/be5435fb-bdcd-4d0e-978c-884b5aa32128 => generated 269 bytes in 190 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:41:13.973365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:13.973745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:13.978822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.979348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.979779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:13.980469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:13.980915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:13.981344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:14.001159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.compute.api [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Instance is already in deleting state, ignoring this request Sep 19 11:41:14.012330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a12518b-8e75-4a93-9391-6d98e069936f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 204 len: 0 microversion: 2.1 time: 0.257234 Sep 19 11:41:14.012330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 974/1981] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 0 bytes in 259 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:41:14.012330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:14.012330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:14.018153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:14.019951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:14.020398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:14.021695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:14.022667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:14.022990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:14.042123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 HTTP/1.1 Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:41:14.043807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:14.046365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '908c5502-74d2-42f5-bd69-d99ade535859'} Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:14.054938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:41:14.056732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.058229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:14.058229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cea8ea8d-ff6e-43ba-952f-7a19e25800f5 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 404 len: 111 microversion: 2.1 time: 0.041628 Sep 19 11:41:14.058229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 975/1982] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:41:14 2022] DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:41:14.058229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:14.060156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:14.067230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:14.068067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:14.068301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:14.069020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:14.070345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:14.070345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:14.087603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lazy-loading 'services' on Instance uuid 95347db7-c8c7-4731-8d6c-32d6fec8d721 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 11:41:14.148321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:14.163978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0c377cdc-1d2e-4ebd-a65e-a2f8d5fd99b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1382 microversion: 2.1 time: 0.106468 Sep 19 11:41:14.163978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 976/1983] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1382 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:14.163978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-213e6d47-5e85-4b27-a152-468453055e31 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '.version_select at 0x7f4b9a4073a0>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:14.167266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Request method failure captured: Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b HTTP/1.1 Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFJEoOTjbJZCDcv9fChyLvfI4r1btyoXxi7aDQqBzkdtgLFcF1bJMaXZlknsz7voW2FeT5gvj5PqtSU9_bRqMLlQ3BNnaznGYvDzRqZS0SvzOYYkylN17blyvdJsePZIWp3WL8Ezhoc3Cb5uGuznN_eVN3GlgpcWQv_ueuvTybvotHY Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:41:14.168341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/575748e2f3ee4df18ce5aa403175b66f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 575748e2f3ee4df18ce5aa403175b66f Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-970313362 Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 4682f63b56d24450b2605b5b4c2129d9 Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-VolumesSnapshotTestJSON-970313362-project Sep 19 11:41:14.170039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'server_id': '95347db7-c8c7-4731-8d6c-32d6fec8d721', 'id': 'ed5634c5-3a81-4fb1-9737-86409b2a798b'} Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:14.170831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 19 11:41:14.172252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.173709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:14.184765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) Sep 19 11:41:14.186134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:41:14.187680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78ff96a2-9b55-423c-a13d-d61a038d6101) {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:41:14.187680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-87a914ab-1773-4562-830a-600f88f3cd79 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b" status: 400 len: 269 microversion: 2.1 time: 0.211165 Sep 19 11:41:14.187680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1008/1984] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 11:41:13 2022] DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721/os-volume_attachments/ed5634c5-3a81-4fb1-9737-86409b2a798b => generated 269 bytes in 212 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 11:41:14.260436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-213e6d47-5e85-4b27-a152-468453055e31 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254060146" status: 202 len: 0 microversion: 2.1 time: 0.102746 Sep 19 11:41:14.261048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 977/1985] 10.222.0.78 () {58 vars in 1221 bytes} [Mon Sep 19 11:41:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1254060146 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:41:15.182368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:15.183020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:15.189318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:15.189824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:15.190269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:15.191559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:15.192014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:15.192441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:15.256210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:15.264084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85ecc474-ffa4-4f4c-98e0-ec86e8955c30 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086086 Sep 19 11:41:15.264656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1009/1986] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:15.493699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-5c5e0fe2-d1ca-48f5-916c-675ab13d2144 req-a8f2341e-7764-41e7-b6be-739fa389fc13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba241cb3-089a-4eef-a681-bddf2cb387bd", "name": "network-vif-deleted", "tag": "96003a8a-4fc4-452c-bf1a-dded308d6faa"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:41:15.505934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-5c5e0fe2-d1ca-48f5-916c-675ab13d2144 req-a8f2341e-7764-41e7-b6be-739fa389fc13 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:15.506401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-5c5e0fe2-d1ca-48f5-916c-675ab13d2144 req-a8f2341e-7764-41e7-b6be-739fa389fc13 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:15.506832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-5c5e0fe2-d1ca-48f5-916c-675ab13d2144 req-a8f2341e-7764-41e7-b6be-739fa389fc13 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:15.516967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-5c5e0fe2-d1ca-48f5-916c-675ab13d2144 req-a8f2341e-7764-41e7-b6be-739fa389fc13 service nova] Creating event network-vif-deleted:96003a8a-4fc4-452c-bf1a-dded308d6faa for instance ba241cb3-089a-4eef-a681-bddf2cb387bd on hv-cinder-82282 Sep 19 11:41:15.522521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-5c5e0fe2-d1ca-48f5-916c-675ab13d2144 req-a8f2341e-7764-41e7-b6be-739fa389fc13 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033024 Sep 19 11:41:15.523102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 978/1987] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:41:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:41:16.286709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:16.287426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:16.294023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:16.294508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:16.294946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:16.295672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:16.296130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:16.296557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:16.357213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:16.365644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe2b89c9-1cdb-41d9-9f05-6eb0e838d88b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083376 Sep 19 11:41:16.366214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1010/1988] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:17.389048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:17.389692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:17.396008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:17.396495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:17.396935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:17.397630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:17.398073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:17.398490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:17.460571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:17.468357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c763e303-12cd-4ab6-bfd5-dead9eb11fc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084453 Sep 19 11:41:17.468921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 979/1989] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:18.491914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:18.492608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:18.498913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:18.499429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:18.499863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:18.500582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:18.501028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:18.501446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:18.562549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:18.570404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bddfb2fa-f46c-46e5-9d21-b30262025824 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083100 Sep 19 11:41:18.570964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1011/1990] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:19.592736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:19.593525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:19.600394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:19.600878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:19.601309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:19.601999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:19.602447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:19.602861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:19.666515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:19.674726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce638a25-7279-4793-9ffa-7e387790a83b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086079 Sep 19 11:41:19.675320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 980/1991] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:20.699106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:20.699724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:20.706219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:20.706697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:20.707134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:20.708439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:20.708895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:20.709323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:20.769266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:20.777726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bc815836-0746-4c63-a1e9-30315189bb4e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082665 Sep 19 11:41:20.778295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1012/1992] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:21.799590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:21.800206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:21.806858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:21.807377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:21.807820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:21.808511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:21.808968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:21.809396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:21.870148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:21.877920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f3ce4c5f-d213-4964-905b-6a353716f459 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082378 Sep 19 11:41:21.878477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 981/1993] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:22.901399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:22.902000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:22.908330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:22.908806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:22.909233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:22.909913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:22.910359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:22.910777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:22.976353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:22.984485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-feed2d18-e2c5-47ff-a8f9-c08ad039576d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087708 Sep 19 11:41:22.985164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1013/1994] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:24.008007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:24.008603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:24.015054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:24.015577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:24.016018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:24.016709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:24.017168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:24.017595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:24.080192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:24.087963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e643598-7881-4158-96ea-a8e10c82f30f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084548 Sep 19 11:41:24.088537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 982/1995] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:25.110559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:25.111296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:25.117803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:25.118293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:25.118734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:25.119620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:25.120083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:25.120516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:25.183570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:25.191577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-96c6f780-662b-47cb-a769-e744ac6032ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084858 Sep 19 11:41:25.192653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1014/1996] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:26.215279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:26.215996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:26.222449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:26.224024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:26.224150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:26.224800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:26.225261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:26.225689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:26.287239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:26.295116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6fcd23db-62a0-45ef-81b5-48eef2c8b943 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083746 Sep 19 11:41:26.295712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 983/1997] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:27.318931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:27.319575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:27.326150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:27.326627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:27.327093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:27.327822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:27.328273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:27.328695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:27.389507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:27.397408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-172c08b7-b241-46a3-823a-1a57d6d30ecc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082894 Sep 19 11:41:27.398134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1015/1998] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:28.421046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:28.421634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:28.428733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:28.429217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:28.429654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:28.430346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:28.430806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:28.431252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:28.494509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:28.502304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4d592322-01d7-4a1a-a388-0301cc1c07d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085294 Sep 19 11:41:28.502885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 984/1999] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:29.525104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:29.525747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:29.532263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:29.532747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:29.533182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:29.533868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:29.534322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:29.534749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:29.595911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:29.604212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2513d351-911f-46f5-ab37-9c051bd56156 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082991 Sep 19 11:41:29.604779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1016/2000] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:30.628519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:30.629138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:30.636144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:30.636634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:30.637070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:30.637771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:30.638230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:30.638657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:30.701682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:30.709402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-70abd856-9cdd-44fb-bccd-d443a4dd412f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084813 Sep 19 11:41:30.709966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 985/2001] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:31.732547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:31.733124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:31.740200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:31.740678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:31.741111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:31.741831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:31.742285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:31.742706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:31.802848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:31.810634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9f7cd1e6-8bbc-4eb5-acdc-3f7bb4b8a269 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082060 Sep 19 11:41:31.811226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1017/2002] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:32.834439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:32.835034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:32.841647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:32.842140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:32.842570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:32.843286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:32.843753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:32.844179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:32.907515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:32.915779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cd83723f-6550-4076-b957-997c0edd3689 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085215 Sep 19 11:41:32.916343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 986/2003] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:33.941174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:33.941750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:33.944779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=31 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:33.949578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:33.950065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:33.950508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:33.951263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:33.951725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:33.952155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:33.956181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=89 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:34.014546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:34.022361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a6d1f976-19b6-4abe-962a-fcbb7ab33bd1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086053 Sep 19 11:41:34.022926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1018/2004] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:35.045740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:35.046351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:35.048861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=32,nova_api:DELETE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:35.054228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:35.054717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:35.055159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:35.055877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:35.056336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:35.056761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:35.059350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:41:35.120484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:35.128533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f9814834-5483-4343-b674-395550578802 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086667 Sep 19 11:41:35.129107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 987/2005] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:36.152898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:36.153508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:36.159473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:36.159959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:36.160395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:36.161082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:36.162106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:36.162532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:36.222823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:36.231194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-96325efa-606c-4fb6-8952-fac6d3565159 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082358 Sep 19 11:41:36.231763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1019/2006] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:37.253470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:37.254080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:37.261094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:37.261573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:37.262009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:37.262697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:37.263156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:37.263612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:37.327198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:37.335108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6a0ab550-87dc-4d35-9763-1757bc7c3733 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085551 Sep 19 11:41:37.335710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 988/2007] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:38.358521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:38.359146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:38.365597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:38.366078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:38.366559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:38.367217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:38.367670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:38.368091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:38.428863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:38.437015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-013745b3-3072-49c2-b2a5-701d576f5cd3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082074 Sep 19 11:41:38.437579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1020/2008] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:39.462219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:39.462891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:39.469167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:39.469664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:39.470104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:39.470802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:39.471295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:39.471723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:39.537063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:39.545438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0dfd2883-a59b-453f-83c9-993188551b64 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.089431 Sep 19 11:41:39.546027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 989/2009] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:40.568746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:40.569353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:40.575746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:40.576219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:40.576645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:40.577325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:40.577773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:40.578191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:40.641553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:40.649307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-54042304-2080-4e3e-b974-ca8dda39e921 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084406 Sep 19 11:41:40.649877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1021/2010] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:41.671989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:41.672563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:41.678963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:41.684401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:41.684401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:41.684401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:41.684401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:41.684801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:41.744853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:41.752657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-37af686e-ef3f-4b84-95cc-9dc4f3cfb290 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084644 Sep 19 11:41:41.753225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 990/2011] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:42.776155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:42.776770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:42.783322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:42.783810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:42.784248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:42.784938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:42.785399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:42.785824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:42.846375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:42.854273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7b4d897a-e014-4cc3-8bc5-35a713b02961 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082038 Sep 19 11:41:42.854866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1022/2012] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:43.877551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:43.878162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:43.885293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:43.885777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:43.886218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:43.886917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:43.887407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:43.887840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:43.948904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:43.956623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6ca595a9-2065-44e6-a552-8e3f5a29b298 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083003 Sep 19 11:41:43.957200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 991/2013] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:44.980950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:44.981637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:44.988541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:44.989021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:44.989458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:44.990152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:44.990596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:44.991013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:45.055818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:45.063975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5f888987-a153-44f2-af9e-5f7a5747d019 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086864 Sep 19 11:41:45.064550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1023/2014] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:46.086277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:46.086835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:46.093336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:46.093830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:46.094269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:46.094975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:46.095464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:46.095897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:46.163209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:46.170952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f7cb28c6-d476-4636-bee9-8c57f944f95d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088817 Sep 19 11:41:46.171561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 992/2015] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:47.193945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:47.194559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:47.200984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:47.201463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:47.201903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:47.202635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:47.203093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:47.203554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:47.265347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:47.273238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-00c92c88-bce3-474d-b5aa-67c0c4239ae7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083236 Sep 19 11:41:47.273824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1024/2016] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:48.295586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:48.296107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:48.298504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:41:48.298643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:41:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:41:48.307024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:48.307553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:48.307994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:48.308690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:48.309148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:48.309574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:48.371156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:48.379052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cc9e04aa-9cb5-4f2a-9161-c2d8b56fb690 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087493 Sep 19 11:41:48.379652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 993/2017] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:48 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:49.403613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:49.404228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:49.410641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:49.411128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:49.411608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:49.412307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:49.412767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:49.413202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:49.476042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:49.483663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-55ad4524-6f5d-406a-bc7b-aae3431c7e2f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083910 Sep 19 11:41:49.484217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1025/2018] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:50.507286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:50.507894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:50.514308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:50.514796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:50.515261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:50.515951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:50.516406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:50.516827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:50.580686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:50.589121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f6722aec-2af2-452d-8731-6244080c9f24 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085772 Sep 19 11:41:50.589694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 994/2019] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:51.611713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:51.612338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:51.614272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:41:51.614411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:41:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:41:51.617610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:41:51.617733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:41:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:41:51.625784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:51.626203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:51.626710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:51.627436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:51.627895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:51.628327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:51.694479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:51.702915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-225bae89-bdce-4791-88e6-f9108ca7a3e2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.094962 Sep 19 11:41:51.703552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1026/2020] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:52.726855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:52.727616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:52.734938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:52.735467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:52.735912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:52.736613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:52.737069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:52.737497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:52.798190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:52.806083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8dba516c-af41-4b9c-8965-192ec5fae6b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083747 Sep 19 11:41:52.806686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 995/2021] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:53.829912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:53.830512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:53.838090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:53.838586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:53.839017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:53.839751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:53.840202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:53.840637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:53.902980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:53.910655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-135a9995-d3b4-45ca-ae1f-6480086981d0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084661 Sep 19 11:41:53.911331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1027/2022] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:41:54.934485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:54.935101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:54.942043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:54.942533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:54.942980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:54.943764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:54.944767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:54.945200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:55.008636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:55.016589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-abfc952b-2106-454a-a4ed-32281c32f73c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086042 Sep 19 11:41:55.017154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 996/2023] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:56.040384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:56.041012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:56.047392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:56.047881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:56.048324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:56.049023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:56.049481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:56.049909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:56.112605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:56.120867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0aece424-874b-4833-aba1-5f996c9a86de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084922 Sep 19 11:41:56.121432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1028/2024] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:57.143941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:57.144569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:57.151004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:57.151532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:57.151970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:57.152659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:57.153125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:57.153539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:57.214584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:57.222329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a0a80164-7c2c-4cac-9319-8123aa69d818 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082364 Sep 19 11:41:57.222887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 997/2025] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:58.245664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:58.246315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:58.252730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:58.253200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:58.253627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:58.254416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:58.254869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:58.255350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:58.315896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:58.323575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3fc6304b-7a66-423c-ab9b-3fe4d1f172a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082382 Sep 19 11:41:58.324166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1029/2026] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:41:59.346820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:41:59.347463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:41:59.354541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:59.355019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:59.360389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:59.360389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:41:59.360389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:41:59.360389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:41:59.423526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:41:59.431522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bfb6ea1b-5856-4732-8b0b-1846bf863f1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088888 Sep 19 11:41:59.434993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 998/2027] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:41:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:42:00.454837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:00.455435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:00.461790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:00.462271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:00.462708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:00.463436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:00.463887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:00.464315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:00.524329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:00.532084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bf6aefea-4a31-498e-ab14-0c51b2e33b91 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081208 Sep 19 11:42:00.532680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1030/2028] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:01.556445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:01.557061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:01.563761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:01.564270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:01.564712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:01.565409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:01.565867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:01.566293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:01.627155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:01.635521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5d8038b7-619d-40f5-817d-cf807f3316f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083898 Sep 19 11:42:01.636092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 999/2029] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:02.657687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:02.658320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:02.664335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:02.664820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:02.665262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:02.665953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:02.666407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:02.666833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:02.728184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:02.735851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-723f0c35-6696-4c8c-9bef-5a778debcb07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082659 Sep 19 11:42:02.736431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1031/2030] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:03.757960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:03.758711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:03.765280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:03.765765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:03.766210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:03.766913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:03.767474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:03.767904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:03.831973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:03.840326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d95bb764-bb3a-4b55-a8a3-0bbcd69b3022 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086281 Sep 19 11:42:03.840889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1000/2031] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:04.863398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:04.864011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:04.867038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=28 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:04.876315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:04.876849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:04.877279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:04.878005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:04.878456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:04.878871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:04.881607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=84 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:04.948586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:04.956652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d210ea1f-6ee7-4d8d-8bc7-5baa1089fb99 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.097095 Sep 19 11:42:04.957300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1032/2032] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:05.979464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:05.980065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:05.982619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=28 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:05.987551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:05.988040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:05.988482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:05.989179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:05.989636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:05.990063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:06.052832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:06.061393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e5d21481-8a68-42d3-a408-1f00df5c2d0d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085872 Sep 19 11:42:06.061966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1001/2033] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:07.084816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:07.086114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:07.093879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:07.094404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:07.094840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:07.095570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:07.096026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:07.099744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:07.162646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:07.170426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-48264b89-c386-4d16-ac66-328456ef94e4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.089534 Sep 19 11:42:07.170980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1033/2034] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:08.193163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:08.193767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:08.200656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:08.201133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:08.201561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:08.202243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:08.202690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:08.203109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:08.205655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=90 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:08.267120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:08.275332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e3f239dc-0267-4769-a620-5187db060d58 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085965 Sep 19 11:42:08.275902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1002/2035] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:09.298591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:09.299265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:09.306687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:09.307210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:09.307639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:09.308344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:09.308803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:09.309234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:09.373214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:09.380938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8271bddd-e654-4116-bb85-c648e020636c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086239 Sep 19 11:42:09.381507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1034/2036] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:10.403385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:10.404006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:10.410330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:10.412114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:10.412114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:10.412114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:10.412498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:10.412932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:10.474221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:10.481889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e2dd4d9e-a293-4d22-80b0-3fcf126a9d60 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082601 Sep 19 11:42:10.482457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1003/2037] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:42:11.504560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:11.505186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:11.512227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:11.515367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:11.515367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:11.515367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:11.515367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:11.515739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:11.579113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:11.587580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4c0c5f1c-5fe5-40c0-922d-3d922ab9264d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086866 Sep 19 11:42:11.588139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1035/2038] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:12.610505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:12.611110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:12.617622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:12.618095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:12.618526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:12.619247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:12.619694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:12.620114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:12.682723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:12.690993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9ee61756-0fa5-46f3-b3e7-d137b8960e2e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084513 Sep 19 11:42:12.691600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1004/2039] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:13.713792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:13.714509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:13.721313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:13.721810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:13.722249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:13.722953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:13.723444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:13.723867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:13.787675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:13.796696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-34ca3eed-e7da-493b-b04c-19c8a5484eb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086923 Sep 19 11:42:13.797295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1036/2040] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:14.069972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:14.070552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:14.077298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:14.077897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:14.078393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:14.079270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:14.079652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:14.080090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:14.109965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:42:14.370912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e09e7952-907d-4836-9def-d63cfd59f558 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 204 len: 0 microversion: 2.1 time: 0.304698 Sep 19 11:42:14.371556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1005/2041] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:42:14 2022] DELETE /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:42:14.379693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:14.380467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:14.386399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:14.386891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:14.387360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:14.388051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:14.388513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:14.388950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:14.522487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:14.531365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c0264a16-8292-4edc-a71d-b31b1babbfce tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.155558 Sep 19 11:42:14.531937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1037/2042] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:14.820926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:14.821609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:14.827429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:14.827902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:14.828333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:14.829024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:14.829471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:14.829890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:14.892034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:14.900245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a22e9b6f-83ab-4657-8787-5dcde343efc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083561 Sep 19 11:42:14.900803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1006/2043] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:15.554366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:15.554988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:15.562060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:15.562544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:15.563005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:15.563733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:15.564191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:15.564672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:15.710137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:15.718683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a9bd6a5b-6e7f-4a89-adc4-3f5cdeaa36f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1734 microversion: 2.1 time: 0.168451 Sep 19 11:42:15.719287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1038/2044] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:42:15.924229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:15.924760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:15.931841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:15.932550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:15.932989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:15.933692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:15.934243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:15.934668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:16.023947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:16.032702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b6ce6825-cd54-4888-9c38-f5c14d857c9d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.112498 Sep 19 11:42:16.037434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1007/2045] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:16.073400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-8586fc17-1088-4c5f-9266-d846e81ce38f req-d334762c-f8bc-44ff-aabe-d8679219c8f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3837b49-df54-4e20-a19e-5be03f339e84", "name": "network-vif-deleted", "tag": "cbe41e13-72d5-4704-b65e-18b44b17bea1"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:42:16.084509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8586fc17-1088-4c5f-9266-d846e81ce38f req-d334762c-f8bc-44ff-aabe-d8679219c8f9 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:16.086779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8586fc17-1088-4c5f-9266-d846e81ce38f req-d334762c-f8bc-44ff-aabe-d8679219c8f9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:16.086779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8586fc17-1088-4c5f-9266-d846e81ce38f req-d334762c-f8bc-44ff-aabe-d8679219c8f9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:16.097234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-8586fc17-1088-4c5f-9266-d846e81ce38f req-d334762c-f8bc-44ff-aabe-d8679219c8f9 service nova] Creating event network-vif-deleted:cbe41e13-72d5-4704-b65e-18b44b17bea1 for instance c3837b49-df54-4e20-a19e-5be03f339e84 on hv-cinder-82282 Sep 19 11:42:16.103381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-8586fc17-1088-4c5f-9266-d846e81ce38f req-d334762c-f8bc-44ff-aabe-d8679219c8f9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033600 Sep 19 11:42:16.104341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1039/2046] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:42:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:42:16.741930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:16.742551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:16.748669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:16.749165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:16.749601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:16.750308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:16.750767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:16.752972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:16.815771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:16.824535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e3000a11-4062-4006-8c90-7d7bdfe2d903 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086676 Sep 19 11:42:16.825135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1008/2047] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:17.072092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:17.072786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:17.079272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:17.079764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:17.080206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:17.080911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:17.081366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:17.081794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:17.148814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:17.157109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dc2b1060-7f5f-4066-b5b2-70859a9f64d4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.090381 Sep 19 11:42:17.157782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1040/2048] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:17.847664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:17.848247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:17.854805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:17.855318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:17.855754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:17.856489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:17.856887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:17.857336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:17.921892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:17.931053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1705579e-5d53-442a-9b14-f0f3122df539 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087169 Sep 19 11:42:17.931664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1009/2049] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:18.180735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:18.181360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:18.188023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:18.188503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:18.188934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:18.189613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:18.190067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:18.190487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:18.251046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:18.258648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70eb2486-c35a-4e74-940f-1602043f51b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082285 Sep 19 11:42:18.259231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1041/2050] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:18.953980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:18.954525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:18.961615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:18.962182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:18.962633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:18.963748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:18.963873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:18.964230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:19.026009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:19.034232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5f1ff4c2-280c-478f-90d3-2aa67acfb64f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084228 Sep 19 11:42:19.034796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1010/2051] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:19.281236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:19.281884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:19.288887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:19.289372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:19.289820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:19.290511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:19.290970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:19.291428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:19.353950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:19.361766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5118decd-c36e-4441-95f9-d0fe60fe61cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084444 Sep 19 11:42:19.362329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1042/2052] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:20.057053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:20.057822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:20.065708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:20.066211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:20.066651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:20.067395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:20.067901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:20.068343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:20.149852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:20.158416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-75a952e6-d66c-4292-aff4-b625d42b8e9c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.105495 Sep 19 11:42:20.159007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1011/2053] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:20.385871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:20.386461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:20.392933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:20.393415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:20.393855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:20.394577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:20.395010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:20.395476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:20.457802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:20.465615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1550991a-11f9-407c-8dd1-812d6f018c52 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085128 Sep 19 11:42:20.466182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1043/2054] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:21.181748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:21.182416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:21.189224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:21.189708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:21.190143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:21.190880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:21.191380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:21.191804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:21.252686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:21.261042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7b4aeee-92f7-46eb-bd56-68f560348f6e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083204 Sep 19 11:42:21.261616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1012/2055] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:21.488761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:21.489376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:21.495853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:21.496333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:21.496844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:21.497454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:21.497908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:21.498333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:21.558975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:21.566985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-87594575-8822-4ffe-a59b-68b23fab9c28 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082194 Sep 19 11:42:21.567574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1044/2056] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:22.284457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:22.285066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:22.291605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:22.292090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:22.292530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:22.293221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:22.293686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:22.294115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:22.358991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:22.367351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-540c8495-6bc5-404f-9e87-32fbfdb4007c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086714 Sep 19 11:42:22.367892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1013/2057] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:22.588416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:22.589019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:22.595418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:22.595899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:22.596329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:22.597007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:22.597454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:22.597875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:22.658113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:22.666509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-df97e5bc-06be-4167-8cd5-b76ccb23d099 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081858 Sep 19 11:42:22.667094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1045/2058] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:23.394722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:23.395489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:23.402274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:23.402761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:23.403222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:23.403925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:23.404377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:23.404802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:23.466440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:23.474519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-065b8e32-5c6d-4948-9a0f-a80f7aa09360 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086529 Sep 19 11:42:23.475088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1014/2059] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:23.689768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:23.690374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:23.696786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:23.697260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:23.697696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:23.698383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:23.698833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:23.699286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:23.761467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:23.769587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c3341b45-22d4-40a8-8f97-2f4ff04df381 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083745 Sep 19 11:42:23.770160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1046/2060] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:24.498204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:24.498831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:24.505298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:24.505781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:24.506218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:24.506904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:24.507393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:24.507824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:24.570978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:24.579757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-064edd90-93fb-486c-8d59-c161f14c1f28 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085516 Sep 19 11:42:24.580353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1015/2061] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:24.793643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:24.794202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:24.800602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:24.801087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:24.801530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:24.802224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:24.802684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:24.803122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:24.863818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:24.872235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-71dc1060-d0c9-48a7-83b2-aa8998e996b4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083329 Sep 19 11:42:24.872803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1047/2062] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:25.601860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:25.602605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:25.609114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:25.609602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:25.610056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:25.610750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:25.611231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:25.611663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:25.672911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:25.681194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3316a476-bec7-4270-885f-aab2b97ae78d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083247 Sep 19 11:42:25.681771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1016/2063] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:25.894687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:25.895938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:25.902563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:25.903049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:25.903563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:25.904269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:25.904728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:25.905159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:25.968659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:25.976600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7ebea6db-80e1-4b04-ac01-0c582ba41dea tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085807 Sep 19 11:42:25.977189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1048/2064] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:26.707507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:26.708123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:26.714798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:26.715324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:26.715768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:26.716517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:26.716980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:26.717413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:26.720090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:26.781936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:26.790232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aac9237c-bf72-4dd3-97b1-d04d63292a89 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086659 Sep 19 11:42:26.792756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1017/2065] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:26.999330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:26.999941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:27.006569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:27.007100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:27.007613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:27.008836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:27.009303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:27.009765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:27.025629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:27.073515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:27.081275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1bd3166a-67c1-4d72-9f4a-a3cb86c2dc47 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085918 Sep 19 11:42:27.081880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1049/2066] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:27.813867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:27.814416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:27.822016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:27.822501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:27.822939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:27.823664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:27.824182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:27.827007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:27.888778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:27.897040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e8b8d015-2fa0-447b-bbb1-8744454c3601 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087587 Sep 19 11:42:27.897619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1018/2067] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:28.103922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:28.104475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:28.111033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:28.111588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:28.112027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:28.112727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:28.113181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:28.113613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:28.176867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:28.185672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7c7ce5c9-8c2c-402b-b733-1fee9aabc94c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085855 Sep 19 11:42:28.186460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1050/2068] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:28.920901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:28.921547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:28.927987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:28.928475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:28.928915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:28.929605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:28.930064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:28.930512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:28.994388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:29.002737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-384b1ce7-cfb2-47dd-9cc4-c0f37a9662a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085803 Sep 19 11:42:29.003338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1019/2069] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:29.208949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:29.209513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:29.216673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:29.217156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:29.217601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:29.218261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:29.218711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:29.219129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:29.280101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:29.287856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1b53e6ec-1c32-43c1-a669-482df8ffc698 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082841 Sep 19 11:42:29.288457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1051/2070] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:30.027380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:30.027996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:30.034447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:30.034990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:30.035465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:30.036230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:30.036692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:30.037183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:30.099201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:30.108030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bab0d715-a086-4ad8-bc1d-8cd8b5d8a3c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084529 Sep 19 11:42:30.108608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1020/2071] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:30.310826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:30.311398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:30.317785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:30.318262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:30.318695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:30.319410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:30.319863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:30.320290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:30.381076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:30.388864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f5430342-29e9-4da7-9c11-f3cad1e64fbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082359 Sep 19 11:42:30.389421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1052/2072] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:31.131405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:31.132022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:31.139228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:31.139716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:31.140153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:31.140842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:31.141294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:31.141717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:31.206470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:31.214885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c2aaf6d3-3d88-4c1a-89ee-38ce514252a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087468 Sep 19 11:42:31.215491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1021/2073] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:31.412331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:31.412977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:31.420273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:31.420746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:31.421181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:31.421867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:31.422316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:31.422735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:31.484261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:31.492410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0f44ae46-b084-4d2f-8a4b-199b356937d7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084223 Sep 19 11:42:31.493678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1053/2074] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:32.237569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:32.238113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:32.244514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:32.245014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:32.245431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:32.246118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:32.246570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:32.246994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:32.307895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:32.316421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0ebf71ce-abf8-4221-9905-f97fc4f0fda9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082780 Sep 19 11:42:32.317033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1022/2075] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:32.516135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:32.516749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:32.523118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:32.523627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:32.524058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:32.524742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:32.525193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:32.525619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:32.587930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:32.595888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1bec044c-2222-4b4d-b9f2-b4d840c24310 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083651 Sep 19 11:42:32.596461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1054/2076] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:33.339865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:33.340453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:33.346722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:33.347234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:33.347676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:33.348393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:33.348850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:33.349274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:33.412621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:33.421039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-972d9155-197d-4f9a-8a12-f705db49677b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085150 Sep 19 11:42:33.421618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1023/2077] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:33.618455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:33.619087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:33.625651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:33.626132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:33.626566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:33.627288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:33.627741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:33.628165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:33.689477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:33.698049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-89ce2bf0-97b4-405a-bbca-8811ddb89b81 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083538 Sep 19 11:42:33.698615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1055/2078] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:34.444828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:34.445372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:34.451787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:34.452302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:34.452748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:34.453488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:34.453941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:34.454369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:34.516973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:34.525348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6914ca00-b450-4f59-8e76-39a359a215f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084550 Sep 19 11:42:34.525926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1024/2079] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:34.721843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:34.722380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:34.728861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:34.729347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:34.729788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:34.730479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:34.730944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:34.731406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:34.791960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:34.799755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e5f172b-8deb-47ca-a66b-f62834e1cce3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081897 Sep 19 11:42:34.800319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1056/2080] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:35.548633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:35.549552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:35.555758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:35.556244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:35.556683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:35.557380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:35.557837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:35.558263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:35.621688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:35.629998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-81449d69-301b-4af5-967b-4f658d271f3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085261 Sep 19 11:42:35.630863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1025/2081] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:35.823048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:35.823700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:35.826028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=50 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:35.832889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:35.833728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:35.834474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:35.835697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:35.836476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:35.837797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:35.900893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:35.908757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0a51a0f0-3403-44aa-9f83-10b0287b6618 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.089589 Sep 19 11:42:35.909333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1057/2082] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:36.652924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:36.653548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:36.655853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:36.660544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:36.661029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:36.661476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:36.662166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:36.662624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:36.663051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:36.727976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:36.736059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d3238968-9266-4bee-9502-6bb26fa2c4b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087047 Sep 19 11:42:36.736628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1026/2083] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:36.931547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:36.932085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:36.938790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:36.939304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:36.939771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:36.940461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:36.940919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:36.941350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:37.003203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:37.011635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ddaf5c38-e2af-4c59-97ee-61e282b4080f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084068 Sep 19 11:42:37.012202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1058/2084] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:37.758686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:37.759343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:37.765776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:37.766269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:37.766712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:37.767468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:37.767923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:37.768350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:37.831713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:37.840476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-25da0a6d-e0b9-4ed0-a5ff-92534f4d85b0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085669 Sep 19 11:42:37.841038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1027/2085] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:38.034010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:38.034557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:38.041833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:38.042316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:38.042755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:38.043483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:38.043940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:38.044373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:38.105947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:38.114107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f959cd9e-ac6a-4f59-b9fc-c91beba3ab9b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083990 Sep 19 11:42:38.114684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1059/2086] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:38.864100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:38.864740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:38.871280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:38.871765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:38.872201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:38.872889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:38.873342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:38.873769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:38.934785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:38.943066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-13b8f6ba-4712-463b-a9d9-a7410bf68c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082876 Sep 19 11:42:38.943674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1028/2087] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:39.137789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:39.138429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:39.144840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:39.145326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:39.145761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:39.146446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:39.146901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:39.147363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:39.209161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:39.217260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5456fcf2-7f0b-4c4f-8816-943e5a35a896 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083890 Sep 19 11:42:39.217868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1060/2088] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:39.966189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:39.966803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:39.973163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:39.973653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:39.974101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:39.974783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:39.975260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:39.975733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:40.040351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:40.048790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b39a1c2d-71c2-41d9-bdb7-2a341839bb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086841 Sep 19 11:42:40.049356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1029/2089] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:40.240498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:40.241176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:40.248332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:40.248835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:40.249262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:40.249961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:40.250517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:40.250964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:40.316411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:40.324722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c3be07c9-8c9b-4675-a572-2d933c26c2db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088297 Sep 19 11:42:40.325311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1061/2090] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:41.074720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:41.075754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:41.082322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:41.082813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:41.083289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:41.083996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:41.084459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:41.084887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:41.164279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:41.172559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-749631f1-d4df-45cd-ab12-6f593a8452a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.104112 Sep 19 11:42:41.173138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1030/2091] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:41.348237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:41.349015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:41.357874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:41.358363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:41.358798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:41.359546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:41.360000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:41.360430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:41.428408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:41.436968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7ff6a5bc-24c0-43ce-b7cb-2c1c049a98ab tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.092781 Sep 19 11:42:41.437536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1062/2092] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:42.197564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:42.198177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:42.204597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:42.205085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:42.205536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:42.206229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:42.206684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:42.207111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:42.271840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:42.284252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2b7ea543-961b-477f-a31e-e3e1f442daf2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.090472 Sep 19 11:42:42.284945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1031/2093] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:42.461026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:42.461571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:42.468460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:42.468928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:42.469368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:42.470100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:42.470554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:42.470976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:42.531137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:42.538757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d9a2fdb1-c2ef-482f-b4ec-9d4325eb7409 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081692 Sep 19 11:42:42.539345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1063/2094] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:43.308376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:43.309019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:43.315815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:43.316429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:43.316866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:43.317554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:43.318008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:43.318433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:43.380485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:43.388702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a49c2aac-d560-47e3-80c2-9bd3dea3f22b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084818 Sep 19 11:42:43.389266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1032/2095] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:43.562565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:43.563205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:43.569584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:43.570069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:43.570511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:43.571218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:43.571681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:43.572111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:43.632319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:43.640750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ed47680f-07c6-481b-b0be-c8a437f53ab6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082275 Sep 19 11:42:43.641355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1064/2096] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:44.411537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:44.412108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:44.419221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:44.419719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:44.422819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:44.422819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:44.422819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:44.422819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:44.486243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:44.488435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:44.495046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-47857a8a-af55-40f4-94ba-cca085162175 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087751 Sep 19 11:42:44.495652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1033/2097] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:44.663621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:44.664166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:44.671154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:44.671666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:44.672103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:44.672791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:44.673249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:44.673679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:44.734621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:44.742352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e83f5385-eed6-44ee-8002-3fbc536bced6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082766 Sep 19 11:42:44.742922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1065/2098] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:45.517735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:45.518379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:45.525291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:45.525780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:45.526216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:45.526910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:45.527400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:45.527828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:45.588561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:45.596698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aad768be-8926-4a7a-8f29-73d4d8599123 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082834 Sep 19 11:42:45.597267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1034/2099] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:45.764849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:45.765462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:45.771855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:45.772329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:45.772755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:45.773429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:45.773875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:45.774293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:45.776949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:42:45.836077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:45.843727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1008cb21-ce8e-454b-9f03-b6a7594a7988 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082813 Sep 19 11:42:45.844290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1066/2100] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:46.619921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:46.620543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:46.627028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:46.627549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:46.627992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:46.628693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:46.629153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:46.629583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:46.696068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:46.704558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d5f618ae-f608-426a-acfd-6fefa2cc8b58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089179 Sep 19 11:42:46.705138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1035/2101] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:46.865893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:46.866553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:46.873129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:46.873543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:46.873970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:46.874644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:46.875092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:46.875542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:46.935886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:46.943394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7776fb0c-e841-444d-ad7d-5d5cdd087a4c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081322 Sep 19 11:42:46.943954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1067/2102] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:47.728544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:47.729103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:47.735670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:47.736151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:47.736598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:47.737275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:47.737732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:47.738157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:47.800962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:47.809918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ab0e6866-fa28-4619-a10d-37c5ff3c7262 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085379 Sep 19 11:42:47.810482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1036/2103] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:47.965907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:47.966653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:47.973157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:47.973642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:47.974082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:47.974773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:47.975265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:47.975730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:48.039727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:48.048925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d7678bc1-427c-4996-a355-f8798919b7db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086889 Sep 19 11:42:48.049500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1068/2104] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:48.832683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:48.833291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:48.839800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:48.840289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:48.840764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:48.841473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:48.841988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:48.842421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:48.908131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:48.916818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1c48196a-bb40-4605-a68f-f83820d53ce1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088069 Sep 19 11:42:48.917388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1037/2105] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:49.072670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:49.073284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:49.079737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:49.080235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:49.080664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:49.081349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:49.081807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:49.082232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:49.142779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:49.151160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-900641af-efff-4ac5-99ae-d54e55e55722 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082403 Sep 19 11:42:49.151763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1069/2106] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:49.940372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:49.940984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:49.947608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:49.948097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:49.948539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:49.949236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:49.949694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:49.950124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:50.011439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:50.019740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c010a3b9-7b82-4c4a-b1d9-b63c45d26d3f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083260 Sep 19 11:42:50.020339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1038/2107] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:50.174430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:50.175043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:50.181496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:50.186824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:50.186824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:50.186824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:50.186824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:50.187260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:50.246318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:50.253503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dbab5a53-577f-4504-9b4c-7180157321b3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083093 Sep 19 11:42:50.254069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1070/2108] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:51.044326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:51.044941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:51.051679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:51.052165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:51.052600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:51.053480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:51.053943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:51.054375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:51.120570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:51.129233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-95595aca-6715-481f-8f84-dc0e8089925e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089269 Sep 19 11:42:51.129804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1039/2109] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:51.277507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:51.278185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:51.284876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:51.285379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:51.285816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:51.286519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:51.286973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:51.287575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:51.349904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:51.358526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4f02b728-802c-4a8c-a708-f971361bf5cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085476 Sep 19 11:42:51.359098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1071/2110] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:52.152389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:52.152996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:52.159505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:52.159985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:52.160416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:52.161108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:52.161560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:52.161981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:52.224560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:52.232757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6ea4a436-78c3-4e37-be20-d033a40af49d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084334 Sep 19 11:42:52.233328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1040/2111] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:52.381809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:52.382353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:52.388704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:52.389192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:52.389608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:52.390288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:52.390738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:52.391159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:52.452604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:52.460352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fb30c8f3-ed88-45c5-ada2-fe243dee96a8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082531 Sep 19 11:42:52.460948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1072/2112] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:53.254975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:53.255603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:53.262559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:53.263040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:53.263500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:53.264190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:53.264637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:53.265057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:53.328222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:53.336217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7eb6b9e4-f7c5-4dcf-817d-01e5c7864a2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085114 Sep 19 11:42:53.336779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1041/2113] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:53.482903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:53.483547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:53.490064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:53.490550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:53.490989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:53.491707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:53.492163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:53.492591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:53.552911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:53.560878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-96fdc419-4223-487c-bd40-91c39451bf5a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081815 Sep 19 11:42:53.561447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1073/2114] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:54.359758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:54.360371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:54.366883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:54.367347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:54.367794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:54.368489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:54.368948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:54.369375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:54.433136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:54.441655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4420a62c-611f-4edc-8184-396dbf62ecfa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085742 Sep 19 11:42:54.442226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1042/2115] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:54.583528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:54.584160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:54.591183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:54.591682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:54.592123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:54.592811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:54.593266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:54.593697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:54.655795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:54.663443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fb5f6b57-463a-4ec6-8493-b8afc9989c54 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083833 Sep 19 11:42:54.664013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1074/2116] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:55.464967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:55.465582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:55.472079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:55.472571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:55.473013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:55.473715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:55.474200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:55.474626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:55.539842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:55.548932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d3080089-dbe0-491e-b49a-e86d1d3e04b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087954 Sep 19 11:42:55.549508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1043/2117] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:55.686982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:55.687551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:55.693908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:55.694385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:55.694814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:55.695532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:55.695982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:55.696400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:55.908104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:55.916370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-27741a26-268c-4400-8500-630d9fee8739 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.233631 Sep 19 11:42:55.916935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1075/2118] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:56.571703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:56.572320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:56.578961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:56.579485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:56.579927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:56.580629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:56.581089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:56.581517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:56.647599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:56.656434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-08e797ce-96ed-4bc1-9eda-5ef6ace049ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088591 Sep 19 11:42:56.657005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1044/2119] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:56.945408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:56.946034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:56.954017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:56.954504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:56.954943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:56.955696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:56.956162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:56.956614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:57.021299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:57.029784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-24ea77a0-ff6d-4db0-9909-29efa10fd084 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088352 Sep 19 11:42:57.030351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1076/2120] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:57.679789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:57.680349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:57.687254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:57.687736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:57.688180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:57.688881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:57.689342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:57.689771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:57.753295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:57.762084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4a1a415d-5181-4024-a88a-bd32f58b6d0a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086264 Sep 19 11:42:57.762655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1045/2121] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:58.052762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:58.053377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:58.060896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:58.061344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:58.061786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:58.062516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:58.062976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:58.063443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:58.124694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:58.132581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b5d39b7c-0277-425a-ba4b-5c89610a2b4a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083767 Sep 19 11:42:58.133145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1077/2122] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:58.785458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:58.786111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:58.793303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:58.793791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:58.794231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:58.794928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:58.795418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:58.795850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:58.856577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:58.864974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ec3d0308-7f99-4b31-a238-bbd808f23297 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083387 Sep 19 11:42:58.865540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1046/2123] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:42:59.156428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:59.157031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:59.163769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:59.164267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:59.164982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:59.165426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:59.165886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:59.166319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:59.226813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:59.234578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-066c3b44-1e2e-4913-82ae-7633da89f069 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082069 Sep 19 11:42:59.235130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1078/2124] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:42:59.888179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:42:59.888829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:42:59.895293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:59.895770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:59.896204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:59.896887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:42:59.897338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:42:59.897756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:42:59.966973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:42:59.975126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cbc64d19-9c6d-42df-85e3-43a8dd878187 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.091348 Sep 19 11:42:59.976057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1047/2125] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:42:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:00.258213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:00.258943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:00.267100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:00.267837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:00.268408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:00.269116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:00.269549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:00.269967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:00.332281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:00.340822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-77354f22-20bb-4258-a4fa-06934bf484b8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086900 Sep 19 11:43:00.341386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1079/2126] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:00.998114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:00.998766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:01.005417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:01.005901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:01.006340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:01.007191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:01.007651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:01.008091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:01.072242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:01.081195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b09b854e-f5d0-4101-adfb-e5b20379c813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087751 Sep 19 11:43:01.081794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1048/2127] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:43:01.364020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:01.364573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:01.371584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:01.372073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:01.372514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:01.373201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:01.373659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:01.374087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:01.435559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:01.443343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-22d2b773-405a-4b85-b5b7-e1f3b0339918 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083325 Sep 19 11:43:01.443909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1080/2128] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:02.104214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:02.104806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:02.111446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:02.111952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:02.112393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:02.113094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:02.113554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:02.113980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:02.177521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:02.186028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b86ce0ea-9409-46ba-915a-84b7e61ac991 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085753 Sep 19 11:43:02.186601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1049/2129] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:02.466902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:02.467499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:02.473856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:02.474335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:02.474765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:02.475489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:02.475938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:02.476360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:02.540472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:02.548687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70c4fdf7-e87e-40b2-844f-9a8e339bfeed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086242 Sep 19 11:43:02.549243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1081/2130] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:03.209592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:03.210201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:03.216783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:03.217273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:03.217716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:03.218406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:03.218858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:03.219315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:03.233835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.291029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:03.299365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-955e523f-d6e4-4480-a6ea-322edfe5f658 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.093898 Sep 19 11:43:03.299948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1050/2131] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:03.571457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:03.572039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:03.578639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:03.579113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:03.579568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:03.580251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:03.580699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:03.581119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:03.650939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:03.653243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:03.659809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4f87d1c-8eaa-41a7-8e6e-7e8dac611855 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.092135 Sep 19 11:43:03.660288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1082/2132] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:43:04.323601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:04.324198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:04.330605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:04.331097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:04.331730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:04.332409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:04.332875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:04.333300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:04.548688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:04.557112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3ce8a8e3-5124-451a-adc4-cb7d82af30a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.237396 Sep 19 11:43:04.558236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1051/2133] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:04.684246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:04.684834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:04.691100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:04.691607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:04.692040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:04.692715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:04.693170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:04.693591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:04.971711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:04.979641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-01656170-e430-42aa-8f83-f2de6f834b87 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.299806 Sep 19 11:43:04.980215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1083/2134] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:05.580959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:05.581591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:05.588030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:05.588519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:05.588965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:05.589722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:05.590186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:05.590614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:05.650693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:05.658858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8e62004c-bbf3-49d3-9c7f-170b9ea7503d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082008 Sep 19 11:43:05.659522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1052/2135] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:43:06.003450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:06.004056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:06.006342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=54 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:06.011115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:06.011623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:06.012058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:06.012748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:06.013194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:06.013612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:06.075892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:06.083851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d09eb6ba-8fee-49db-b95d-69a85181cc14 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084305 Sep 19 11:43:06.084434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1084/2136] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:06.681887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:06.682490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:06.689482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:06.689971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:06.690414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:06.691110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:06.691596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:06.692023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:06.753327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:06.762358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6218d2d4-2065-46a6-b993-9e81b40955e5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084357 Sep 19 11:43:06.762934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1053/2137] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:07.110387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:07.111844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:07.118954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:07.119994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:07.120457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:07.121163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:07.121626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:07.122059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:07.187628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:07.195322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e977c5ed-790d-4dd5-9742-283b023d69b5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.093287 Sep 19 11:43:07.196116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1085/2138] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:07.785653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:07.786311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:07.788774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:07.794159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:07.794641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:07.795077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:07.795792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:07.796251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:07.796712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:07.859506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:07.867536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b5e9df6-2d5b-49e2-b53f-7852541fe313 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085763 Sep 19 11:43:07.868101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1054/2139] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:08.219113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:08.219756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:08.226073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:08.226558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:08.226997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:08.227708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:08.228167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:08.228601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:08.288580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:08.296811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-12372351-4d09-4d87-8e67-7a383804d73d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081569 Sep 19 11:43:08.297386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1086/2140] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:08.890056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:08.890700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:08.897244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:08.897735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:08.898183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:08.898877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:08.899376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:08.899809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:08.960755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:08.970024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a8a35ef5-88a7-4551-a75f-5fdff7646c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084395 Sep 19 11:43:08.970602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1055/2141] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:09.320119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:09.320724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:09.327777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:09.328257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:09.328687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:09.329369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:09.329814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:09.330233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:09.396285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:09.404124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e82beb67-06fd-4f71-ace3-341e02325991 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087811 Sep 19 11:43:09.404682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1087/2142] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:09.993507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:09.994131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:10.000248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:10.000740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:10.001186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:10.001885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:10.002348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:10.002783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:10.066695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:10.074940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b70a6f04-1318-498e-af85-0b4824e2a84c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085868 Sep 19 11:43:10.075549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1056/2143] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:10.426427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:10.427038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:10.434279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:10.434756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:10.435210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:10.435930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:10.436381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:10.436804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:10.498692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:10.506394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1772f14a-7237-4279-8d24-9a6f3df8387b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083859 Sep 19 11:43:10.506962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1088/2144] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:11.098035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:11.098643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:11.105388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:11.105881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:11.106325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:11.107036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:11.107540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:11.107971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:11.172177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:11.180684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-38f0e762-c0b5-47c3-8ba4-2d9938f5668f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086551 Sep 19 11:43:11.181254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1057/2145] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:11.530434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:11.531046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:11.537599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:11.538187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:11.538628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:11.539379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:11.539824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:11.540257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:11.605173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:11.613021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f087e7a4-3021-4c43-9f8d-c819c89ce344 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087073 Sep 19 11:43:11.613576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1089/2146] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:12.203792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:12.204400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:12.210837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:12.211359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:12.211792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:12.212482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:12.212930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:12.213347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:12.287697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:12.296793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b24ac955-5564-43a1-81f5-00a6cf24af02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.096942 Sep 19 11:43:12.297569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1058/2147] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:12.635642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:12.636195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:12.642482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:12.642957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:12.643426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:12.644109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:12.644556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:12.644976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:12.706143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:12.713968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7e2058c4-5f1e-473e-9e15-b6f0b1f82744 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082350 Sep 19 11:43:12.714538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1090/2148] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:13.320388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:13.320973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:13.327425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:13.327905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:13.328340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:13.329024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:13.329477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:13.329900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:13.394192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:13.402673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b5891987-3a9f-4733-a648-73fae4c5c13e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086086 Sep 19 11:43:13.403244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1059/2149] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:13.737705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:13.738297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:13.745441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:13.745936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:13.746378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:13.747082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:13.747575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:13.748008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:13.814241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:13.822092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-781ebe8e-35c0-4cac-b41a-f3f190bc2217 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088529 Sep 19 11:43:13.822659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1091/2150] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:14.426336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:14.426956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:14.433775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:14.434204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:14.434648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:14.435380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:14.435943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:14.436330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:14.498341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:14.514345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f351a2ca-bcbb-4721-96e4-cf078221d4fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.092242 Sep 19 11:43:14.514957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1060/2151] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:14.846076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:14.846677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:14.853149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:14.853652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:14.854121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:14.854806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:14.855286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:14.855721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:14.916634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:14.924482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d36b5ad8-10cc-4923-86ba-a8b42fd87395 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082334 Sep 19 11:43:14.925052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1092/2152] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:15.537691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:15.538273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:15.544917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:15.545422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:15.545868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:15.546569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:15.547037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:15.547499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:15.611006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:15.619354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f8a75eaf-a935-4102-a5f2-86c23e0181d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085599 Sep 19 11:43:15.619970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1061/2153] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:15.948322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:15.948946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:15.955404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:15.955862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:15.956293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:15.956969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:15.957424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:15.957846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:16.019432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:16.027779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2c542079-ff44-4144-9b35-dcef748992ca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083964 Sep 19 11:43:16.028348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1093/2154] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:16.642267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:16.642864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:16.649353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:16.649831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:16.650266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:16.651504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:16.651959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:16.652380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:16.714581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:16.722806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-051269ad-7ea5-45d8-8f9f-6bd5d9779524 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084402 Sep 19 11:43:16.723392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1062/2155] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:17.050722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:17.051437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:17.057941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:17.058713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:17.059198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:17.059865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:17.060320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:17.060746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:17.125244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:17.133164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0c42a6a6-5902-43f0-b85a-20f088e85e23 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086484 Sep 19 11:43:17.133733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1094/2156] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:17.746492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:17.747180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:17.753521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:17.754014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:17.754458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:17.755155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:17.755633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:17.756115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:17.823948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:17.832725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7f17220c-621d-44d3-9e85-1cbbc8b739a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.090643 Sep 19 11:43:17.833326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1063/2157] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:18.157133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:18.157744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:18.164225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:18.164696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:18.165142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:18.165831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:18.166290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:18.167371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:18.227632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:18.236215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9ac44d97-e0fb-42bb-ae22-29800d90ccdf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082963 Sep 19 11:43:18.236781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1095/2158] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:18.855614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:18.856228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:18.862645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:18.863135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:18.863609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:18.864306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:18.864768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:18.865200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:18.926506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:18.934948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-433fe07d-b853-470e-8e01-670779f20e19 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083205 Sep 19 11:43:18.935580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1064/2159] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:19.258911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:19.259589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:19.266651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:19.267136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:19.267617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:19.268312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:19.268771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:19.269202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:19.331467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:19.340195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45ff0843-194c-46c8-9121-3ecd609b9d79 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084799 Sep 19 11:43:19.340461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1096/2160] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:19.959000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:19.959650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:19.966807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:19.967338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:19.967783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:19.968477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:19.968939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:19.969370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:20.035641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:20.045516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9172b3e4-d5de-4164-8480-bbf6cecb5a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.090542 Sep 19 11:43:20.046088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1065/2161] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:20.363093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:20.363934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:20.370750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:20.371342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:20.371881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:20.372715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:20.373153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:20.373675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:20.438658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:20.445816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-73a35921-5faa-4828-b565-167ad805a45b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086569 Sep 19 11:43:20.450918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1097/2162] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:21.067962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:21.068610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:21.075032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:21.075599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:21.076044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:21.076739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:21.077198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:21.077628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:21.142141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:21.150514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ac7566ca-fefb-46d4-a83c-607c0fb939e7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086462 Sep 19 11:43:21.151788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1066/2163] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:21.468700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:21.469319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:21.475788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:21.476271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:21.476704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:21.477390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:21.477841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:21.478264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:21.539614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:21.547852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bd1d1cd7-aae5-4f43-982b-105597cd0c9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083003 Sep 19 11:43:21.548421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1098/2164] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:22.174035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:22.174636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:22.181042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:22.181549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:22.181986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:22.183564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:22.184014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:22.184436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:22.186922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.248343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:22.256512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-204e336d-e34a-4b13-94a8-480ba090f9d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086400 Sep 19 11:43:22.257075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1067/2165] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:22.571781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:22.572425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:22.578870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:22.579389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:22.579920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:22.580588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:22.580982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:22.581412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:22.595921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:22.641988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:22.649713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b924deb2-2a7d-4a66-9225-af0c630941c9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081835 Sep 19 11:43:22.650275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1099/2166] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:23.280448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:23.281120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:23.287483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:23.287972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:23.288412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:23.289111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:23.289570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:23.290000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:23.350434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:23.358679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8b577c4a-33fc-455f-bedb-b2f5fe38ed73 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082821 Sep 19 11:43:23.359266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1068/2167] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:23.673293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:23.673844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:23.680337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:23.680824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:23.681264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:23.682467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:23.683185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:23.683640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:23.744259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:23.752867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ac22ac5-813d-4bfd-bd1f-93af9f14a19b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083721 Sep 19 11:43:23.753431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1100/2168] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:24.384102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:24.384102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:24.389815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:24.390307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:24.390757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:24.391489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:24.391952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:24.392384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:24.459005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:24.467350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9984ca71-fe0a-4a53-94c5-585469abd784 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089424 Sep 19 11:43:24.467928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1069/2169] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:24.777034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:24.777641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:24.784119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:24.784603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:24.785042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:24.785732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:24.786188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:24.786618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:24.849504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:24.857290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eca8c56c-8122-4827-8def-56cf0d4dcf21 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084828 Sep 19 11:43:24.857856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1101/2170] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:43:25.490836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:25.491461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:25.498222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:25.499113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:25.499294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:25.499930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:25.500428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:25.500861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:25.565151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:25.574043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-43dccde7-c08f-4d56-b5c7-68a89a9867c3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087043 Sep 19 11:43:25.574614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1070/2171] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:43:25.880352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:25.880945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:25.887998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:25.888496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:25.888929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:25.889833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:25.890295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:25.890727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:25.952146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:25.959943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0110781f-16f6-4c54-91b4-9a6883e1c1a2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083515 Sep 19 11:43:25.960599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1102/2172] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:26.598082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:26.598738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:26.605744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:26.606225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:26.606660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:26.607385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:26.607835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:26.608259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:26.672385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:26.680667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87547424-9a08-48c8-b457-3480ea3abafe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086536 Sep 19 11:43:26.681223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1071/2173] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:26.984146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:26.984803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:26.991636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:26.992065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:26.992535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:26.993227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:26.993681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:26.994109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:27.062622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:27.071288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c13c2713-d539-46be-aedc-9e22d75ec925 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.092239 Sep 19 11:43:27.071892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1103/2174] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:43:27.704133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:27.704790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:27.711372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:27.711867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:27.712343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:27.713079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:27.714131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:27.714566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:27.776861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:27.784945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd5c8a39-62c4-4426-9d02-277652894ac0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084853 Sep 19 11:43:27.785514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1072/2175] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:28.095350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:28.095965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:28.102745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:28.103267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:28.104334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:28.104978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:28.105440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:28.105881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:28.168403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:28.176157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f32ae4ed-367d-4558-b39c-ef61528768cc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084763 Sep 19 11:43:28.176722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1104/2176] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:28.807661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:28.808529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:28.815381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:28.815862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:28.816325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:28.817013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:28.817467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:28.817890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:28.882844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:28.891062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6107b455-fc38-4317-bc10-f193c4771352 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087257 Sep 19 11:43:28.891649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1073/2177] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:29.198683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:29.199315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:29.205862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:29.206346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:29.206781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:29.207506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:29.207960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:29.208387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:29.273135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:29.277656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-62832f2e-83f2-46dc-a9f0-bab1528ed43a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082856 Sep 19 11:43:29.278223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1105/2178] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:29.914376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:29.914995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:29.921509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:29.921999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:29.922445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:29.923143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:29.923632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:29.924064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:29.984944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:29.993292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e2939f21-42c4-4bf1-9612-b8d2b27d787d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082814 Sep 19 11:43:29.993854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1074/2179] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:30.300672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:30.301283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:30.308471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:30.308948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:30.309383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:30.310064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:30.310513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:30.310935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:30.370934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:30.378654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-87b1cd8e-ab7c-4c36-bc85-b6655f72fce9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081871 Sep 19 11:43:30.379242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1106/2180] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:31.015885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:31.016501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:31.023448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:31.044730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:31.044730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:31.044730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:31.044730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:31.045194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:31.093183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:31.101573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-19040711-bfe4-403a-bd21-6a1ac00d6fc6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089530 Sep 19 11:43:31.102153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1075/2181] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:31.402762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:31.403347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:31.409758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:31.410243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:31.410682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:31.411408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:31.411887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:31.412299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:31.476153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:31.484537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-38d2aa0f-b9f9-40e0-b6d2-b6110b6bb7cb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086417 Sep 19 11:43:31.485113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1107/2182] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:32.126071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:32.126680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:32.133220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:32.133697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:32.134133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:32.134826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:32.135310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:32.135738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:32.200145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:32.208420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9c51b2a0-5fbd-4735-b6ee-57497a03f8a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086376 Sep 19 11:43:32.208986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1076/2183] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:32.507120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:32.507751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:32.514689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:32.515187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:32.515642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:32.516353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:32.516785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:32.517215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:32.577825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:32.585510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-95b21916-1b9c-473d-9fd4-28b9bba56910 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082362 Sep 19 11:43:32.586075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1108/2184] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:33.231782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:33.232643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:33.238784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:33.239771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:33.240215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:33.240909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:33.241366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:33.241795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:33.304570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:33.313519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2dda0682-0a54-4a8b-857a-c79691387eca tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085657 Sep 19 11:43:33.314073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1077/2185] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:33.609551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:33.610130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:33.616555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:33.617038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:33.617476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:33.618163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:33.618620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:33.619054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:33.680204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:33.689001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3ac95650-23a1-4bb7-8801-dc9cf6ffe870 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083420 Sep 19 11:43:33.694050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1109/2186] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:34.337083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:34.337826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:34.346524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:34.347079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:34.347611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:34.348321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:34.348776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:34.349197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:34.412646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:34.421677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-48ebf7a5-8c70-4f4d-a87d-5d54747a095f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088637 Sep 19 11:43:34.426011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1078/2187] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:34.712448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:34.713553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:34.719421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:34.719925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:34.720367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:34.721058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:34.721519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:34.721949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:34.782094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:34.789842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-349218bb-6f0f-46c1-a19d-e9ce865d1554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081509 Sep 19 11:43:34.790413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1110/2188] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:35.445515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:35.446128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:35.453181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:35.453665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:35.454103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:35.454791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:35.455283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:35.455704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:35.519635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:35.528307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a5eea38a-a5e6-4568-9d31-8c70220734fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086567 Sep 19 11:43:35.528884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1079/2189] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:35.823295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:35.823904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:35.830381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:35.830869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:35.831403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:35.832091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:35.832544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:35.832970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:35.893776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:35.901647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-90d47691-f6da-4362-8aaa-63577f18d406 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082290 Sep 19 11:43:35.902216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1111/2190] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:36.551637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:36.552257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:36.558846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:36.559383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:36.559834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:36.560525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:36.560985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:36.561415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:36.622832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:36.631015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fa29af3e-3887-4eeb-b928-826e2165c7a7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083257 Sep 19 11:43:36.631602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1080/2191] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:36.924926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:36.925473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:36.927808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=56 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:36.933267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:36.933751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:36.934188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:36.934877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:36.935372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:36.935805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:36.998705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:37.006463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-25f6607e-386f-4eb6-9cfa-7bceb5a252b1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085507 Sep 19 11:43:37.007023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1112/2192] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:37.654242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:37.654860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:37.661363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:37.661855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:37.662300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:37.662992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:37.663552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:37.663957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:37.727736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:37.735996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b20ac98-94b2-4160-8b65-fbcff227b668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085652 Sep 19 11:43:37.736570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1081/2193] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:38.029693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:38.030325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:38.037004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:38.037496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:38.037939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:38.038634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:38.039092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:38.039581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:38.101096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:38.109464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d83a384f-1e37-4ca4-8158-13fe3aab580a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083602 Sep 19 11:43:38.110050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1113/2194] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:38.759203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:38.760428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:38.762577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:38.767280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:38.767761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:38.768202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:38.768886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:38.769338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:38.769760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:38.831448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:38.840540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fcfb2d94-204f-42eb-8651-3b59ce0a3b72 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085193 Sep 19 11:43:38.841118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1082/2195] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:39.132937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:39.133585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:39.140013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:39.140494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:39.140931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:39.141624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:39.142078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:39.142501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:39.205109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:39.213631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a8a6d55a-fb33-4fb5-bad7-b01dcc259bff tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084578 Sep 19 11:43:39.214286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1114/2196] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:39.866538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:39.867205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:39.873981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:39.874470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:39.874913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:39.875910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:39.876370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:39.876801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:39.941951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:39.944205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:39.951601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2edbb4ea-299a-4319-9c06-030679030703 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088896 Sep 19 11:43:39.952169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1083/2197] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:43:40.237318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:40.237880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:40.244344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:40.244827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:40.245271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:40.245963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:40.246417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:40.246896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:40.308550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:40.316503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ca03d926-f80a-479a-af27-340ce1c224c6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083142 Sep 19 11:43:40.317082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1115/2198] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:40.974420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:40.975065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:40.982569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:40.983052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:40.983531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:40.984237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:40.984697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:40.985118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:41.047998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:41.056323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f9063e5c-b483-43bb-8e47-ea22315dddb0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085773 Sep 19 11:43:41.057780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1084/2199] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:41.338865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:41.339500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:41.346062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:41.346546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:41.346987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:41.347716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:41.348189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:41.348620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:41.351256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:41.412364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:41.420497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6abd7bf4-f2d0-42a9-ad07-dbb8386f37b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085492 Sep 19 11:43:41.424941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1116/2200] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:42.080115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:42.080724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:42.087266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:42.087745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:42.088755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:42.089447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:42.089897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:42.090317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:42.159864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:42.170972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fa399501-b003-483a-b563-00e6e041ebe0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.094993 Sep 19 11:43:42.171592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1085/2201] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:42.444076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:42.444679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:42.451739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:42.455718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:42.455718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:42.455718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:42.455718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:42.456139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:42.516389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:42.524328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7f320022-39c6-4156-8f10-8a4decbd7f5d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084232 Sep 19 11:43:42.525016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1117/2202] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:43.195145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:43.195813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:43.202263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:43.202754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:43.203218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:43.203916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:43.204380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:43.204808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:43.266123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:43.274251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4d3e8207-7604-4cb3-9be7-cd34acb645a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083122 Sep 19 11:43:43.274820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1086/2203] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:43.547752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:43.548353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:43.554737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:43.555241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:43.555673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:43.556350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:43.556797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:43.557215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:43.617008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:43.625248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d9c281bd-a201-4013-985b-ce2569b5f33a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081379 Sep 19 11:43:43.625797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1118/2204] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:44.297776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:44.298408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:44.304895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:44.305386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:44.305824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:44.306517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:44.307015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:44.307747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:44.371434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:44.379685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8a541a85-c0bb-4a2e-8eef-4f08b61c7f9b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085734 Sep 19 11:43:44.380262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1087/2205] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:44.648661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:44.649239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:44.655662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:44.656138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:44.656570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:44.657249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:44.657698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:44.658119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:44.719138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:44.726916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a30bfbcf-8b05-490c-8973-d4de2f591933 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082175 Sep 19 11:43:44.727489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1119/2206] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:45.405252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:45.405794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:45.412183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:45.412675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:45.413122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:45.413829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:45.414283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:45.414714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:45.476101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:45.485252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ead155de-03bd-4e7e-9ada-ccbe8cb85771 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084451 Sep 19 11:43:45.485835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1088/2207] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:45.750636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:45.751267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:45.757886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:45.758358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:45.758785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:45.759495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:45.760465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:45.760885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:45.823497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:45.831135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7cbc233f-9798-43bc-a0fd-933f507fcf7a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084356 Sep 19 11:43:45.831720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1120/2208] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:46.508151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:46.508859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:46.515187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:46.515667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:46.516107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:46.516794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:46.517254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:46.517684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:46.583004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:46.591905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-39650f96-ecfa-4154-ad82-30be30a43ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087610 Sep 19 11:43:46.592477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1089/2209] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:46.855033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:46.855615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:46.862188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:46.862674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:46.863116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:46.863845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:46.864303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:46.864732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:46.924767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:46.932725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6bcbca12-e568-4223-a74f-00b3353d5081 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082063 Sep 19 11:43:46.933306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1121/2210] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:47.615106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:47.615737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:47.622392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:47.622882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:47.623365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:47.624064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:47.624527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:47.624956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:47.687500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:47.696413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-deec857d-f991-47ac-856a-0e6d7ec55e01 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085134 Sep 19 11:43:47.699236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1090/2211] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:47.958279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:47.958827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:47.966236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:47.966710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:47.967144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:47.967846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:47.968301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:47.968726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:48.030002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:48.037779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-116dedf4-95e3-4ba6-adba-863582a63880 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083733 Sep 19 11:43:48.038345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1122/2212] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:48.719606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:48.720247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:48.722472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:43:48.722626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:43:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 (ip 10.222.0.78) !!! Sep 19 11:43:48.733810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:48.734369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:48.734849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:48.735584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:48.736048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:48.736479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:48.800292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:48.808937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7e310018-9322-4e06-9f05-cbb6af384630 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.093149 Sep 19 11:43:48.809515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1091/2213] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:49.060372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:49.061012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:49.067752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:49.068237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:49.068671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:49.069359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:49.069813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:49.070238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:49.131386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:49.139877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f7bed8c8-4747-40c9-b64b-09c193db2b73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084159 Sep 19 11:43:49.140440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1123/2214] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:49.832040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:49.832623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:49.839615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:49.840093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:49.840525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:49.841205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:49.841654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:49.842078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:49.902194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:49.910379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7ebf03f8-786b-4a80-a8fb-f3d85afc5d4c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082156 Sep 19 11:43:49.910944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1092/2215] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:50.161628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:50.162229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:50.168552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:50.169074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:50.169502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:50.170240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:50.170688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:50.171106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:50.232547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:50.240275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-354c6c4b-861e-40ce-a648-de06e68350bc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082531 Sep 19 11:43:50.240836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1124/2216] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:50.934663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:50.935440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:50.941659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:50.942146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:50.942583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:50.943305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:50.943765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:50.944232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:51.015027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:51.023874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c841e63f-1aad-480d-8dc0-015ebb6f0641 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.093905 Sep 19 11:43:51.024454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1093/2217] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:51.263566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:51.264213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:51.270781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:51.271306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:51.271748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:51.272449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:51.272909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:51.273386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:51.335916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:51.344325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ed187d86-59ab-4abe-80e8-782c09012da2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084702 Sep 19 11:43:51.344902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1125/2218] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:52.046494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:52.047097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:52.053729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:52.054221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:52.054665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:52.055399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:52.055861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:52.056364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:52.119831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:52.128663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-407a3361-9b4c-4afa-b902-bd4f5b089138 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086197 Sep 19 11:43:52.129237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1094/2219] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:52.367396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:52.367997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:52.374458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:52.374938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:52.375408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:52.376100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:52.376548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:52.376973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:52.437716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:52.445583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b0ab04db-9f18-464c-8b90-be5ec5c9fa4f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082121 Sep 19 11:43:52.446143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1126/2220] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:53.152000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:53.152617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:53.159038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:53.159554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:53.159996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:53.160694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:53.161153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:53.161586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:53.224456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:53.233143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fd47ee5c-1175-48a1-b372-696859948540 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085031 Sep 19 11:43:53.233741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1095/2221] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:53.468660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:53.469303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:53.475827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:53.476322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:53.476760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:53.477452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:53.477910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:53.478339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:53.541044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:53.549475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1a9856d5-ca51-4bfd-850f-c69575642e01 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084802 Sep 19 11:43:53.550044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1127/2222] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:54.256911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:54.257613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:54.264834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:54.265318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:54.265767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:54.266452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:54.266907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:54.267441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:54.330786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:54.339594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-15374e4d-353d-4d7c-8b63-a98591461f84 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086530 Sep 19 11:43:54.340165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1096/2223] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:54.571916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:54.572529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:54.579472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:54.579950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:54.580380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:54.581055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:54.581501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:54.581918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:54.642169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:54.649831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8df69c96-f5dd-4055-b123-4ba819187f29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081793 Sep 19 11:43:54.650388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1128/2224] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:55.362932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:55.363584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:55.370632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:55.371067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:55.371536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:55.372233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:55.372692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:55.373118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:55.436975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:55.445853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-50c3e32c-d368-43a7-989d-e91e51ba0a33 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086612 Sep 19 11:43:55.446435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1097/2225] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:55.674101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:55.674643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:55.681115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:55.681595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:55.682299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:55.682998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:55.683508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:55.683941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:55.745593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:55.753287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a577734c-a2f8-445b-b7ee-c0f4dacee696 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083177 Sep 19 11:43:55.753879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1129/2226] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:56.468970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:56.469518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:56.476074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:56.476562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:56.477005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:56.477709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:56.478170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:56.478600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:56.539239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:56.548075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0af07bb2-3cff-4327-afa1-2602d81a5b24 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083230 Sep 19 11:43:56.548640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1098/2227] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:56.775977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:56.776624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:56.783775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:56.784262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:56.784706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:56.785399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:56.785854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:56.786285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:56.847679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:56.855477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-54767ff9-743a-454a-98fb-eea16d9095a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083345 Sep 19 11:43:56.856044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1130/2228] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:57.571017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:57.571653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:57.578047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:57.578523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:57.578964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:57.579667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:57.580120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:57.580544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:57.643887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:57.652573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6ceed951-098c-4b6b-ae6d-da8364ba990a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085395 Sep 19 11:43:57.653179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1099/2229] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:57.878206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:57.878813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:57.885235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:57.885744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:57.886180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:57.886877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:57.887362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:57.887790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:57.948267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:57.955928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7cea6030-08a3-4066-983c-ace9d522845c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081666 Sep 19 11:43:57.956513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1131/2230] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:58.675108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:58.675749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:58.682388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:58.682871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:58.683348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:58.684548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:58.685008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:58.685435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:58.700665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:58.746523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:58.754763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7aa555ae-71da-48dd-960e-3772319c91fd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083549 Sep 19 11:43:58.755360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1100/2231] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:58.979481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:58.980029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:58.987064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:58.987585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:58.988027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:58.988715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:58.989180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:58.989608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:59.053653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:59.055853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:43:59.063189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cbeca6d5-e3bb-44e5-98cd-70ed25d2c7a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087651 Sep 19 11:43:59.063770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1132/2232] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:43:59.778499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:43:59.779102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:43:59.785475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:59.785947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:59.786376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:59.787054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:43:59.787531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:43:59.787956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:43:59.851036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:43:59.859333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-82a99009-32f6-4539-aa84-7723d710a1a0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085270 Sep 19 11:43:59.859901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1101/2233] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:43:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:00.087596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:00.088161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:00.095267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:00.095750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:00.096223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:00.096914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:00.097368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:00.097797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:00.162176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:00.169849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-84412763-2881-416e-98d5-d75c14cc79ed tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086250 Sep 19 11:44:00.170420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1133/2234] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:00.882194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:00.882835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:00.890583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:00.891122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:00.891637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:00.892767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:00.893290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:00.893765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:00.957325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:00.966039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-130480b6-2a89-4d34-b3ac-366fec440b21 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088021 Sep 19 11:44:00.966614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1102/2235] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:01.193953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:01.194613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:01.201526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:01.202012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:01.202474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:01.203140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:01.203627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:01.204058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:01.265598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:01.274748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3f719864-a790-4969-97be-e75072a918b6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084939 Sep 19 11:44:01.275371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1134/2236] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:01.989669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:01.990302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:01.996689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:01.997167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:01.997596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:01.998327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:01.998776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:01.999214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:02.063002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:02.071462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f5452449-77cf-4c87-8882-924a360b1ae7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085638 Sep 19 11:44:02.072028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1103/2237] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:02.298231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:02.298842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:02.305750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:02.306245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:02.306943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:02.307654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:02.308116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:02.309098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:02.371275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:02.379078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-12cc2acd-3bfe-4d2a-b6cd-ee40dcf472a4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084872 Sep 19 11:44:02.379670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1135/2238] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:03.094534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:03.095157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:03.101590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:03.102075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:03.102510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:03.103221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:03.103681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:03.104110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:03.167509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:03.175647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-324212b0-7cfa-46da-82c8-1974ae219c0b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085034 Sep 19 11:44:03.176214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1104/2239] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:03.402052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:03.402598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:03.408967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:03.409442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:03.409876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:03.410549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:03.410995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:03.411455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:03.473559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:03.481982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-28ffb0b3-8b84-4ac2-b9a8-b65ac62e19db tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083857 Sep 19 11:44:03.482542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1136/2240] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:04.199272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:04.199923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:04.206306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:04.206818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:04.207263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:04.207995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:04.208453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:04.208888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:04.272389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:04.280680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-683f2aba-cc43-494d-8043-6f8419f87283 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085468 Sep 19 11:44:04.281252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1105/2241] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:04.504782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:04.505383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:04.511818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:04.512293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:04.512722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:04.513393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:04.513838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:04.514255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:04.574057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:04.581680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a69df6e7-4f96-453f-90b9-be9547d28c17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.080842 Sep 19 11:44:04.582237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1137/2242] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:05.303539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:05.304170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:05.311289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:05.311779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:05.312214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:05.312909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:05.313371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:05.313790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:05.373818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:05.381979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bc097578-7aba-4f2f-9b5b-4ef50d937649 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082330 Sep 19 11:44:05.382547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1106/2243] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:05.604486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:05.605080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:05.611502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:05.611986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:05.612423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:05.613104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:05.613554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:05.613978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:05.675382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:05.684033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fa1efc21-745f-49b3-95f2-ff0d10b593d2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082867 Sep 19 11:44:05.684599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1138/2244] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:06.405836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:06.406478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:06.412880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:06.413368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:06.413806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:06.414494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:06.414948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:06.415494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:06.480397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:06.488698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-408eba8a-2e49-45f0-9f75-01e5ece964d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087255 Sep 19 11:44:06.489267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1107/2245] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:06.707971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:06.708546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:06.715698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:06.716179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:06.716614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:06.717306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:06.717890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:06.718160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:06.778770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:06.786613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8bcb78fd-277d-4a4c-8169-b7771fce26cf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082606 Sep 19 11:44:06.787193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1139/2246] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:07.511887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:07.512496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:07.518912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:07.519444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:07.519890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:07.520585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:07.521045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:07.521475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:07.582882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:07.591280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42e4b290-7192-4f14-b8b3-344e847612a1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083851 Sep 19 11:44:07.591842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1108/2247] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:07.810155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:07.810767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:07.813110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=56 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:07.817855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:07.818339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:07.818772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:07.819493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:07.819950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:07.820373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:07.884297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:07.892566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d9b6a777-ff65-433e-9c88-7138149cfcc8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087045 Sep 19 11:44:07.893126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1140/2248] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:08.613439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:08.614062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:08.620580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:08.621066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:08.621507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:08.622198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:08.622660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:08.623119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:08.688056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:08.696176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff1c4c2d-b3a8-4c75-95fb-6bb7403df442 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086655 Sep 19 11:44:08.696739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1109/2249] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:08.915921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:08.916466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:08.923328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:08.923820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:08.924256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:08.924945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:08.925433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:08.925863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:08.987092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:08.995142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad2e74a7-80ea-4fca-925b-26f0eb63da40 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083127 Sep 19 11:44:08.995754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1141/2250] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:09.719554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:09.720151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:09.721989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:09.727149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:09.727697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:09.728144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:09.728840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:09.729306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:09.729740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:09.791069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:09.799797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-45b55fb8-53d0-4baf-832a-6e636ee47f93 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084285 Sep 19 11:44:09.800371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1110/2251] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:10.017982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:10.018589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:10.025063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:10.025608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:10.026047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:10.027253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:10.027714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:10.028134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:10.091678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:10.099805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-caee81e0-5379-4c2d-8d8b-b6d65af48139 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085685 Sep 19 11:44:10.100384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1142/2252] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:10.824185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:10.824777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:10.831334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:10.831842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:10.832265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:10.832959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:10.833419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:10.833852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:10.896841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:10.905615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fcd7bc53-6e91-40a5-8d81-d67f05033a02 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085862 Sep 19 11:44:10.906207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1111/2253] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:11.122856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:11.123440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:11.129865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:11.130334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:11.130763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:11.131468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:11.131932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:11.132346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:11.412285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:11.420462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe6ec2f4-6596-4efb-a6c4-c8440fafb7a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.301547 Sep 19 11:44:11.423193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1143/2254] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:11.928564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:11.929181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:11.936597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:11.937086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:11.937530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:11.938555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:11.939023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:11.939486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:12.000760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:12.009033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-82be2166-47a8-400c-a536-f4c51b35db58 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084340 Sep 19 11:44:12.010091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1112/2255] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:12.444463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:12.445066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:12.451628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:12.452108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:12.452545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:12.453226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:12.453682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:12.454109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:12.514161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:12.521915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d2555ac0-d8cd-439a-9935-54b80c554ddb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081380 Sep 19 11:44:12.522487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1144/2256] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:13.032991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:13.033613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:13.040121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:13.040606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:13.041103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:13.041794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:13.042254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:13.043326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:13.102869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:13.112501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7a4a8fa5-fb50-45c9-9c6a-345d1c104e6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083403 Sep 19 11:44:13.113080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1113/2257] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:13.690433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:13.691568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:13.703208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:13.703208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:13.703208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:13.703208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:13.703722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:13.703722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:13.771711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:13.779648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-68b5c234-10cc-4323-a9f6-8173620c2f32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.238855 Sep 19 11:44:13.780277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1145/2258] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:14.135341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:14.135946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:14.142207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:14.142691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:14.143127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:14.143902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:14.144355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:14.144863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:14.206193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:14.214351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-91561310-6c7e-46b3-bfbc-ace8bd95f702 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082950 Sep 19 11:44:14.214936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1114/2259] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:14.803437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:14.804053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:14.810785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:14.811300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:14.811754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:14.812444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:14.812902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:14.813329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:14.874017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:14.881837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d5a266c4-0ad6-4aa1-82df-69b923f2d1be tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082297 Sep 19 11:44:14.882405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1146/2260] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:15.242353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:15.242963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:15.251331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:15.252148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:15.252677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:15.253756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:15.256592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:15.257202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:15.324381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:15.332686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1c23fa1d-7d5b-4f5e-95f7-a2789e5fdb54 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.098276 Sep 19 11:44:15.333334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1115/2261] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:15.905018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:15.905615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:15.912347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:15.912831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:15.913286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:15.913978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:15.914434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:15.914865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:15.980896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:15.988767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4333296e-5d24-45a1-b7f3-4b54d2a67cef tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087648 Sep 19 11:44:15.989342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1147/2262] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:16.358304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:16.358913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:16.365261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:16.365741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:16.366176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:16.366861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:16.367339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:16.367800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:16.428785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:16.437846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4fe333b5-fb6a-4e34-b093-5baae40f35dc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083980 Sep 19 11:44:16.438404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1116/2263] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:17.012334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:17.012927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:17.019639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:17.020123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:17.020562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:17.021250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:17.021708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:17.022133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:17.084034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:17.091967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-26c45f0b-674b-41c1-ada4-6758c8b748e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083512 Sep 19 11:44:17.092539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1148/2264] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:17.460722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:17.461337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:17.468389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:17.473982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:17.473982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:17.473982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:17.473982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:17.474363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:17.474363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:17.534628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:17.543517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3e6d8db3-aad9-48d5-b1dc-8cbffbcddc4f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086171 Sep 19 11:44:17.544173 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1117/2265] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:18.115853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:18.116914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:18.122953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:18.123468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:18.123911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:18.124998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:18.125121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:18.125481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:18.140150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:18.187672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:18.195407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bcec15d9-77ee-4ce1-9450-e5ba2e95e99e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083460 Sep 19 11:44:18.195971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1149/2266] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:18.565745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:18.566334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:18.572742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:18.573221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:18.573656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:18.574338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:18.574786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:18.575229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:18.637190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:18.645377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-14dd7c99-153b-43fb-ad57-e97619113f42 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083575 Sep 19 11:44:18.645949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1118/2267] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:19.219387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:19.219990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:19.226444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:19.226925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:19.227392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:19.228074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:19.228529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:19.228952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:19.292539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:19.300817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d89e4a2e-5f90-412d-ab93-91083026db55 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085327 Sep 19 11:44:19.301397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1150/2268] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:19.668399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:19.668951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:19.675476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:19.675968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:19.676419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:19.677113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:19.677577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:19.678010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:19.742238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:19.750973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4fb2be63-b469-4170-a9dc-f24cbb4f1d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086633 Sep 19 11:44:19.751577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1119/2269] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:20.323889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:20.325206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:20.331771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:20.332253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:20.332685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:20.333368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:20.333815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:20.334238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:20.395019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:20.402867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-944cd348-6b93-47c3-9bec-7ae6b4d2a768 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082946 Sep 19 11:44:20.403465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1151/2270] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:20.773922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:20.774548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:20.781719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:20.782215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:20.782662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:20.783394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:20.783861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:20.784349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:20.845892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:20.854040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3c91c319-b821-4453-acf2-f677ecea838d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084064 Sep 19 11:44:20.854611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1120/2271] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:21.429385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:21.429385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:21.433598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:21.434637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:21.435119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:21.435848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:21.436308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:21.436743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:21.497606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:21.505529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7723e45f-d6da-431f-96fa-1d6847408a1f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083480 Sep 19 11:44:21.506098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1152/2272] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:21.876150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:21.876791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:21.883326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:21.883808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:21.884248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:21.884932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:21.885386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:21.885811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:21.950374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:21.959009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6755499f-7311-4d04-a889-d06392add81a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086776 Sep 19 11:44:21.959615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1121/2273] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:22.529231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:22.529847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:22.536324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:22.536809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:22.537249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:22.537938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:22.538397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:22.538824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:22.602151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:22.610161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-21d11e87-4862-4cdd-917c-a3bfde8093b2 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085666 Sep 19 11:44:22.610723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1153/2274] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:22.982964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:22.983560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:22.989866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:22.990342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:22.990770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:22.991478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:22.991930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:22.992352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:23.056553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:23.065346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-91cb6cec-1155-4a50-b20e-a5d79561b6a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086822 Sep 19 11:44:23.065931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1122/2275] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:23.633864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:23.634486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:23.641891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:23.642372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:23.642811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:23.643535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:23.643997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:23.644425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:23.706322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:23.714223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-49fb3ba4-6cd7-4b5d-a4fb-926c26862d7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084378 Sep 19 11:44:23.715011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1154/2276] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:24.088099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:24.088690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:24.095156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:24.095658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:24.096095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:24.096788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:24.097250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:24.097675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:24.161449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:24.169715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5846e17f-5c21-4f40-a128-c9fe8c1f6ded tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085496 Sep 19 11:44:24.170282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1123/2277] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:24.738002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:24.738607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:24.745263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:24.745755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:24.746198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:24.746888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:24.747385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:24.747817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:24.808756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:24.817005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5baad0a4-065d-4f79-9ad4-40f8f4cbb597 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082981 Sep 19 11:44:24.817573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1155/2278] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:25.193214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:25.193812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:25.200413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:25.200907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:25.201369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:25.202067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:25.202532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:25.202957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:25.263687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:25.271786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bc862e04-211d-4e94-8c7c-01256542905a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082458 Sep 19 11:44:25.272366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1124/2279] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:25.840455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:25.841078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:25.847682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:25.848180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:25.848620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:25.849367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:25.849833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:25.850249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:25.912173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:25.920236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-06a59c16-1bb3-4f46-8319-56c55386d643 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084192 Sep 19 11:44:25.920806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1156/2280] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:26.293938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:26.294554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:26.301162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:26.301644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:26.302081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:26.302760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:26.303238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:26.303686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:26.368154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:26.376249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9ea2b828-e8f4-4882-8852-7ccdd28d5191 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086247 Sep 19 11:44:26.376813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1125/2281] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:26.942808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:26.943435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:26.949905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:26.950886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:26.951352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:26.952036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:26.952490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:26.952911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:27.015676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:27.023574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a78690f7-e0be-4586-9df3-c320edb80472 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084626 Sep 19 11:44:27.024142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1157/2282] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:27.399285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:27.399842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:27.406863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:27.407381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:27.407825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:27.408516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:27.408975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:27.409405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:27.471602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:27.479845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-60cdb2d1-3332-4298-8cd3-a4662a1dcfa7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084553 Sep 19 11:44:27.480425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1126/2283] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:28.046352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:28.046994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:28.053549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:28.054021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:28.054465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:28.055153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:28.055639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:28.056387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:28.118243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:28.126821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6f4f1827-3a13-49a3-a24c-3e89c72e20aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084468 Sep 19 11:44:28.127417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1158/2284] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:28.503190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:28.503825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:28.510419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:28.510909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:28.511394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:28.512088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:28.512549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:28.512984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:28.578475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:28.586746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-813900d1-6354-4c49-bad3-0bef65052dd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087403 Sep 19 11:44:28.587345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1127/2285] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:29.150543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:29.151159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:29.158507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:29.158994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:29.159467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:29.160196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:29.160655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:29.161094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:29.222452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:29.230224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-418f182d-72c3-4d97-9fc7-23ec7bab1ff5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083773 Sep 19 11:44:29.230801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1159/2286] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:29.610119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:29.610736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:29.617243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:29.617734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:29.618178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:29.618903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:29.619401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:29.619860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:29.682705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:29.691702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-253ac040-7efa-4e40-9077-4122fe72f962 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085932 Sep 19 11:44:29.692268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1128/2287] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:30.253337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:30.253977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:30.260458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:30.263042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:30.263042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:30.263042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:30.263042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:30.264061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:30.325754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:30.334100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a4661d2-9d3c-472c-9d08-b464c2a10e5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084614 Sep 19 11:44:30.334656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1160/2288] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:30.714436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:30.714965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:30.721478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:30.721968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:30.722414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:30.723105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:30.723592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:30.724024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:30.787096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:30.795381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d6ff94d6-8ce8-455a-9c15-a736f5fe2a20 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084907 Sep 19 11:44:30.795948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1129/2289] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:31.357366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:31.358060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:31.365270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:31.365747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:31.366206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:31.366896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:31.367388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:31.367811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:31.429891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:31.437882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-04bced6b-4af2-4aec-9c68-b6d4b47ac78d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084738 Sep 19 11:44:31.438450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1161/2290] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:31.818875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:31.819514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:31.826185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:31.827963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:31.827963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:31.827963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:31.828400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:31.828833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:31.890670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:31.898877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b33d5224-5c7d-4e6e-8e72-5faf870b6d2d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083971 Sep 19 11:44:31.899481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1130/2291] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:32.461521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:32.462079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:32.468492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:32.468979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:32.469420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:32.470108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:32.470573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:32.471001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:32.530889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:32.538790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-47b8a21c-6c03-4a6a-985e-d03261a08177 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081250 Sep 19 11:44:32.539389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1162/2292] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:32.922716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:32.923353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:32.929712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:32.930190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:32.930886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:32.931592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:32.932047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:32.932467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:32.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:33.005294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9538b1d5-9557-47a2-971f-ffdff945f61e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086943 Sep 19 11:44:33.005871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1131/2293] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:33.562031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:33.562645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:33.569162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:33.569646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:33.570088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:33.570785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:33.571275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:33.571708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:33.636494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:33.639570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ba2c1ee5-d1ae-449a-bfbc-99733bcdfa4d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081444 Sep 19 11:44:33.640158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1163/2294] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:34.028577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:34.029199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:34.036124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:34.036610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:34.037046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:34.037739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:34.038192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:34.038617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:34.102372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:34.110746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1a2f7246-2e18-4b95-9311-15bcc62a1eed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085985 Sep 19 11:44:34.111554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1132/2295] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:34.663331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:34.663941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:34.669797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:34.670281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:34.670715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:34.671429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:34.671889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:34.672320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:34.732854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:34.740630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ddb0c13e-4aaf-4df6-9ef8-67988cb837a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081438 Sep 19 11:44:34.741200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1164/2296] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:35.133853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:35.134497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:35.140922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:35.141410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:35.141850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:35.142539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:35.142998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:35.143458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:35.207426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:35.209572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:35.216186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e11edbe2-cdd7-46fd-a312-5f52ed990ca9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086236 Sep 19 11:44:35.216756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1133/2297] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:44:35.763265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:35.763884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:35.771967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:35.772480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:35.772919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:35.773657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:35.774117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:35.774547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:35.842238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:35.850751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6c9afeec-7544-4d28-860c-4b8ac433a148 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.091380 Sep 19 11:44:35.851356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1165/2298] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:36.240350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:36.240973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:36.247639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:36.248131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:36.248575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:36.249277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:36.249731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:36.250159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:36.312100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:36.320819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff19f7d8-e433-40be-a3a2-236154b3cfdd tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084780 Sep 19 11:44:36.321386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1134/2299] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:36.874250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:36.874892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:36.881297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:36.881769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:36.882198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:36.882877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:36.883351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:36.883772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:36.886260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:36.945407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:36.953197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3251ee14-310f-4808-8532-a42e295a9124 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082793 Sep 19 11:44:36.953915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1166/2300] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:37.343444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:37.344650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:37.351322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:37.351820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:37.352265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:37.352955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:37.353412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:37.353846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:37.422721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:37.431204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0ec10631-7451-4e34-a8c5-58354d6194d9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.091655 Sep 19 11:44:37.431782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1135/2301] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:37.978502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:37.979151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:37.981493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=54 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:37.986753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:37.987260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:37.987706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:37.988397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:37.988854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:37.989287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:38.055386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:38.064777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fad46451-367d-4274-b4af-ec9c9afe0c73 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.090158 Sep 19 11:44:38.065358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1167/2302] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:38.454969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:38.455616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:38.462115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:38.462633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:38.463078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:38.463799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:38.464261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:38.464695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:38.525878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:38.534790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1bf81e18-cce0-45b0-bcb3-74ec5d0eec91 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083740 Sep 19 11:44:38.535399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1136/2303] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:39.088011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:39.088624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:39.095051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:39.095567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:39.095998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:39.096683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:39.097130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:39.097551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:39.158954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:39.166695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ea756ca1-299a-4124-af1e-cc530ab3e04e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082622 Sep 19 11:44:39.167277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1168/2304] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:39.558282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:39.558887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:39.565503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:39.565983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:39.566419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:39.567102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:39.567580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:39.568003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:39.630426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:39.638658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8d00d343-05af-4b0f-af9b-440d8916feb3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084460 Sep 19 11:44:39.639242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1137/2305] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:40.190098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:40.190694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:40.197348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:40.197861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:40.198298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:40.198987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:40.199476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:40.199907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:40.261213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:40.269648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-65dbc4e8-cc50-421a-93ae-c7f21b66dd76 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083462 Sep 19 11:44:40.270201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1169/2306] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:40.661728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:40.662393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:40.664676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:40.669283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:40.669762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:40.670195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:40.670871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:40.671348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:40.671768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:40.734001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:40.742082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fc367114-c1d9-48a7-a4d4-b6b9d5f67a65 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084184 Sep 19 11:44:40.742653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1138/2307] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:41.293207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:41.293851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:41.300607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:41.301090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:41.301527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:41.302213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:41.302676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:41.303104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:41.364451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:41.373395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b2ceddbf-5c27-430d-9c0c-d803b0bfdd08 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083941 Sep 19 11:44:41.373967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1170/2308] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:41.765101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:41.765716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:41.772708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:41.773194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:41.773635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:41.774322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:41.774780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:41.775235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:41.840406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:41.849328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-680faf06-2cdc-4143-b3da-8b78fde4c00e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088127 Sep 19 11:44:41.849897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1139/2309] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:42.396845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:42.397455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:42.404028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:42.404506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:42.404937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:42.405622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:42.406075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:42.406493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:42.468923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:42.476918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-55cbb296-a6a4-477d-b61d-36bc004195fd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084250 Sep 19 11:44:42.477482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1171/2310] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:42.872223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:42.872836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:42.879953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:42.880435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:42.880871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:42.881561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:42.882015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:42.882443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:42.943813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:42.952049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2a1a1e7b-22df-4521-abe4-2bda2594149c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083710 Sep 19 11:44:42.952748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1140/2311] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:43.500435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:43.501069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:43.507457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:43.507938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:43.508371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:43.509052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:43.509503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:43.509927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:43.570676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:43.578464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-658c051f-0874-4b0f-b2fd-017a47ad7460 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081915 Sep 19 11:44:43.579024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1172/2312] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:43.976181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:43.976730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:43.983285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:43.983775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:43.984221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:43.984910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:43.985381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:43.985799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:44.049674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:44.058189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-92bfb914-ae5b-47a9-a044-a03eea06b687 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085999 Sep 19 11:44:44.058761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1141/2313] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:44:44.601125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:44.601737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:44.608216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:44.608699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:44.609133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:44.609816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:44.610267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:44.610689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:44.673292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:44.681724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aea30198-01e2-4142-bd39-c5113766022d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084465 Sep 19 11:44:44.682294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1173/2314] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:45.081815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:45.082429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:45.088843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:45.089329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:45.089766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:45.090451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:45.090904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:45.091369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:45.154800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:45.163228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bd0065d2-dd06-4e1b-8fc0-de259c652df3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086017 Sep 19 11:44:45.163803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1142/2315] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:45.705119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:45.705749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:45.712076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:45.712546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:45.712973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:45.713643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:45.714090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:45.714509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:45.773907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:45.781558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b028d445-8d09-420a-a6b6-34502445a673 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.080370 Sep 19 11:44:45.782109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1174/2316] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:46.186306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:46.186909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:46.193389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:46.193866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:46.194305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:46.195013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:46.195502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:46.195927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:46.258976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:46.267110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-56287789-b781-4b80-b540-356e2e900d6c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084729 Sep 19 11:44:46.267703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1143/2317] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:46.805473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:46.806071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:46.812411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:46.812889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:46.813320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:46.813994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:46.814438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:46.814859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:46.876307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:46.884611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6bfa3a83-9a42-4ffe-8292-47f0afa744e0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083216 Sep 19 11:44:46.885170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1175/2318] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:47.290753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:47.291403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:47.297863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:47.298350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:47.298792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:47.300112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:47.300573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:47.301005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:47.362664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:47.370999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-64fa5b10-c9b7-4ddb-b110-d30375f42cd6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084160 Sep 19 11:44:47.371534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1144/2319] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:47.908681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:47.909261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:47.915496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:47.915974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:47.916404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:47.917075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:47.917523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:47.917941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:47.979331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:47.987201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5ddebc07-afdb-46ea-9f68-24f251af712a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082358 Sep 19 11:44:47.987762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1176/2320] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:48.393749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:48.394340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:48.400887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:48.401379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:48.401818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:48.402564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:48.403032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:48.403489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:48.468366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:48.477328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8fe26f1a-815e-4097-a252-c90532024380 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087584 Sep 19 11:44:48.477891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1145/2321] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:49.010047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:49.010683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:49.017171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:49.017659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:49.018101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:49.018797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:49.019288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:49.019726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:49.081019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:49.088788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-88b13c9c-a9ea-4f11-97bb-2418c45247de tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082753 Sep 19 11:44:49.089346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1177/2322] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:49.501578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:49.502219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:49.508680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:49.509169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:49.509606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:49.510306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:49.510763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:49.511227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:49.571801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:49.579915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b5c6bcf-3ae2-4160-bd1b-ef0a3543c6a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082259 Sep 19 11:44:49.580488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1146/2323] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:50.111538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:50.112155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:50.118861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:50.119410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:50.119854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:50.120549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:50.121018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:50.121461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:50.183468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:50.192172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2bad86aa-fcea-422e-a798-b4bda513f39a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084596 Sep 19 11:44:50.192747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1178/2324] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:50.603246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:50.603908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:50.610302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:50.610781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:50.611249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:50.611935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:50.612387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:50.612811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:50.675472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:50.683955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-777eb3ff-c0a2-46f8-93dd-2a946acc95ae tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084655 Sep 19 11:44:50.684525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1147/2325] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:51.215906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:51.216501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:51.222997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:51.223510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:51.223940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:51.224631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:51.225076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:51.225497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:51.287273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:51.295187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-46475a7d-88d2-4419-a0eb-3d6d87af762b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083091 Sep 19 11:44:51.295763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1179/2326] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:51.706262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:51.706867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:51.713575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:51.714067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:51.714507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:51.715252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:51.715779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:51.716278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:51.782708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:51.791800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1bcbf623-dcb1-40c9-9a6f-fa0ae6b6fd0e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089649 Sep 19 11:44:51.792375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1148/2327] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:52.318009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:52.318608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:52.325688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:52.326182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:52.326627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:52.327366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:52.327822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:52.328252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:52.394522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:52.402346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6857df81-f672-47c3-b4a9-77b64ee4d934 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088302 Sep 19 11:44:52.402908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1180/2328] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:52.816423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:52.817032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:52.823574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:52.824060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:52.824503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:52.825190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:52.825643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:52.826069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:52.890846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:52.900004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bcea5395-5ea0-471f-9b5a-b82f82a80102 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088337 Sep 19 11:44:52.900590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1149/2329] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:53.426367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:53.427315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:53.434162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:53.434645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:53.435086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:53.435812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:53.436268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:53.436693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:53.497664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:53.505472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-15782b75-144b-401f-8ef8-c978debbf8dc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083899 Sep 19 11:44:53.506038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1181/2330] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:53.923877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:53.924516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:53.931292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:53.931778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:53.932217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:53.932919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:53.933370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:53.933801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:53.950287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:53.996669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:54.005333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-574b2abe-f7f1-466d-9b3c-c477f4a179db tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085395 Sep 19 11:44:54.005896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1150/2331] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:54.528737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:54.529349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:54.536483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:54.536975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:54.537410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:54.538112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:54.538564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:54.539000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:54.599437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:54.601616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:44:54.607813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c72830f8-2092-4735-9aae-01f59f74b149 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082958 Sep 19 11:44:54.608464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1182/2332] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:55.028816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:55.029455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:55.035946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:55.036457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:55.036894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:55.037578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:55.038059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:55.038492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:55.103112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:55.111584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4538e204-ac49-4b50-ac60-8dac49a054d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086562 Sep 19 11:44:55.112709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1151/2333] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:55.630748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:55.631381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:55.638287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:55.638761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:55.639219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:55.639900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:55.640347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:55.640768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:55.702550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:55.711039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-645f65f5-ec26-4dbe-99e4-2b3aab4a4ce1 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084186 Sep 19 11:44:55.711636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1183/2334] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:56.135142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:56.135780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:56.142255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:56.142751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:56.143241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:56.143939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:56.144401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:56.144829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:56.207999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:56.216297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-75914472-5cc5-442d-a32b-7676ccd32334 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085044 Sep 19 11:44:56.216866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1152/2335] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:56.733254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:56.734429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:56.741602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:56.742074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:56.742504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:56.743209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:56.743666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:56.744083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:56.806180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:56.813998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b1ed9001-8135-4ca6-9d02-073a0a2dd32e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084643 Sep 19 11:44:56.814775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1184/2336] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:57.239956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:57.240576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:57.247300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:57.247883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:57.248374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:57.249024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:57.249484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:57.249915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:57.315980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:57.324372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-831abd8d-f928-46cb-afd2-ff4116a42dbf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088976 Sep 19 11:44:57.324948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1153/2337] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:57.837371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:57.838006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:57.844436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:57.844940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:57.845373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:57.846048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:57.846492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:57.846910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:57.907220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:57.914986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8a03873a-b164-4766-92c2-a6ba100b2357 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081546 Sep 19 11:44:57.915586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1185/2338] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:58.347350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:58.347965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:58.354376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:58.354863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:58.355338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:58.356032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:58.356490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:58.356957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:58.418555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:58.427629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e3aaf5a-e2ce-4db7-a673-042c90877218 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084155 Sep 19 11:44:58.428194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1154/2339] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:58.937646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:58.938259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:58.945898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:58.946388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:58.946831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:58.947564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:58.948026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:58.948456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:59.011444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:59.019401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3461297e-12d9-43c5-b22d-b1974ed4d5cd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085548 Sep 19 11:44:59.019969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1186/2340] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:44:59.450696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:44:59.451328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:44:59.457861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:59.458346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:59.458791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:59.459519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:44:59.459985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:44:59.460416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:44:59.525493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:44:59.534471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7e63bf5-0ea3-45bc-a597-7518b5c95e85 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087043 Sep 19 11:44:59.535046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1155/2341] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:44:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:00.041989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:00.042589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:00.049103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:00.049597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:00.050034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:00.050727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:00.051200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:00.051628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:00.117376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:00.125200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7832a9aa-5981-4933-b648-a17a3b80a00c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087162 Sep 19 11:45:00.125775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1187/2342] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:00.557457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:00.558066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:00.564304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:00.564784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:00.565216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:00.565926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:00.566604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:00.567197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:00.627600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:00.636781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ab517a15-8b38-407d-bd93-80ba6e984c00 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083423 Sep 19 11:45:00.637351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1156/2343] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:01.148997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:01.149525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:01.156064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:01.156552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:01.156996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:01.157691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:01.158149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:01.158576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:01.223398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:01.231146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7f55847c-a4de-4a74-af5e-59ac9a6c214d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086639 Sep 19 11:45:01.231714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1188/2344] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:01.661469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:01.662105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:01.668554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:01.669029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:01.669456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:01.670134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:01.670584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:01.671005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:01.733932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:01.742301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f658b802-abc1-42d4-921a-0ddda86a73d3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085203 Sep 19 11:45:01.742865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1157/2345] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:02.255475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:02.256086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:02.262644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:02.263129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:02.263672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:02.264367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:02.264825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:02.265256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:02.327874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:02.335706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a275666f-2792-403d-bb29-49657547951a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084900 Sep 19 11:45:02.336270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1189/2346] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:02.765462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:02.766079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:02.773139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:02.773625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:02.774062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:02.774788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:02.775276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:02.775745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:02.836432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:02.844769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5c516c1c-35fa-4582-b6d7-d1c45d782b44 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083246 Sep 19 11:45:02.845351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1158/2347] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:03.358123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:03.358757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:03.366625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:03.367059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:03.367523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:03.368473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:03.369058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:03.369492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:03.431897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:03.439774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c58d971e-a0af-4e6e-9c1b-080428512bd7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085543 Sep 19 11:45:03.440340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1190/2348] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:03.867960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:03.868583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:03.874978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:03.875499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:03.876066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:03.876761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:03.877223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:03.877655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:03.941978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:03.950145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-964ad867-2675-4cd6-a157-61e1123a9cb5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086130 Sep 19 11:45:03.950712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1159/2349] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:04.462486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:04.463077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:04.469122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:04.469606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:04.470044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:04.470730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:04.471203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:04.471640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:04.530956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:04.538738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-80e6be02-09e0-4dba-b435-fc6506662b6a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.080273 Sep 19 11:45:04.539319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1191/2350] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:04.973380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:04.973988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:04.980437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:04.980919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:04.981363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:04.982048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:04.982506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:04.982932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:05.046051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:05.055554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-31f45df2-4826-4160-af7d-22a3e2337e32 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086536 Sep 19 11:45:05.056115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1160/2351] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:05.562153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:05.562749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:05.569762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:05.570249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:05.570688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:05.571407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:05.571867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:05.572296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:05.635886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:05.643735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5424f370-8fb3-4184-8061-c16c0fc7d9b0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085623 Sep 19 11:45:05.644305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1192/2352] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:06.078061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:06.078625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:06.085339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:06.085832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:06.086278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:06.086973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:06.087578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:06.088017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:06.155294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:06.163621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-36bf86a4-211e-4a84-846f-ca43def20104 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089550 Sep 19 11:45:06.164199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1161/2353] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:06.667948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:06.668646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:06.675031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:06.675552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:06.676015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:06.676705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:06.677165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:06.677596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:06.740640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:06.748482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-43a6a84d-8883-4ef3-ac20-741a83f3a52f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084492 Sep 19 11:45:06.749048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1193/2354] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:07.186694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:07.187343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:07.194376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:07.200838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:07.200838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:07.200838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:07.200838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:07.201272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:07.258309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:07.266622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eec58fc8-861e-4245-8b36-4adb182c28eb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084093 Sep 19 11:45:07.269573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1162/2355] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:07.771968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:07.772587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:07.779247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:07.779737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:07.780183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:07.780909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:07.781365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:07.781796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:07.842701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:07.851060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d8eb353-ae0d-40ce-9322-001688578ba6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082971 Sep 19 11:45:07.851664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1194/2356] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:45:08.291334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:08.291944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:08.298039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:08.298527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:08.299040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:08.299683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:08.300137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:08.300569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:08.366302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:08.374703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-71a0a711-9135-447b-80e1-220131003c3d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088360 Sep 19 11:45:08.375207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1163/2357] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:08.873917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:08.874528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:08.876859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=56 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:08.881596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:08.882081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:08.882521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:08.883233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:08.883692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:08.887669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:08.945064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:08.952885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5018a6c4-5109-42d4-80a6-b5082c43afa8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082839 Sep 19 11:45:08.953447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1195/2358] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:09.398566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:09.399113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:09.401299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:45:09.401427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:45:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 (ip 10.222.0.78) !!! Sep 19 11:45:09.407715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:09.408203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:09.408663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:09.409344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:09.409812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:09.410243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:09.472244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:09.480467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce8e7889-3425-4bbb-af4f-ae4b3fdff8e9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086514 Sep 19 11:45:09.481043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1164/2359] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:09.976712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:09.977313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:09.983983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:09.984474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:09.984918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:09.985614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:09.986074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:09.986524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:10.048642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:10.057438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1e29f2b6-851a-4fe9-9aaf-622c11f61a29 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085508 Sep 19 11:45:10.058076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1196/2360] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:10.503267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:10.503893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:10.510584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:10.511072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:10.511545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:10.512237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:10.512697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:10.513152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:10.576460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:10.585142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0349388a-b74e-4ebf-a92b-1f091876ce38 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085834 Sep 19 11:45:10.585700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1165/2361] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:45:11.081045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:11.081697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:11.089362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:11.089852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:11.090291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:11.091002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:11.091483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:11.091920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:11.155346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:11.163144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7759c87d-dbdd-4528-b391-0af58177ccce tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086547 Sep 19 11:45:11.163732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1197/2362] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:11.608226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:11.608834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:11.611335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:11.616540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:11.617022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:11.617467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:11.618159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:11.618670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:11.619130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:11.683266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:11.691516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4a484a62-a4d6-4a4e-8a1b-b57cf52b4249 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087206 Sep 19 11:45:11.692084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1166/2363] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:12.186758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:12.187402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:12.193941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:12.194430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:12.194873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:12.195603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:12.196065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:12.196495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:12.257774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:12.265537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e4a0b1de-31d7-4780-b784-cb1d21f87814 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082768 Sep 19 11:45:12.266116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1198/2364] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:45:12.715465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:12.715992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:12.722340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:12.722810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:12.723274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:12.723960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:12.724417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:12.724850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:12.727474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:12.788246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:12.796434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e1bc1ab2-2102-4350-b78d-2551b653d9df tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084971 Sep 19 11:45:12.797004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1167/2365] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:13.289135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:13.289832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:13.291814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:45:13.291985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:45:13.292985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:45:13.293134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:45:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:45:13.301423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:13.301905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:13.302339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:13.303033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:13.303517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:13.303942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:13.320126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:13.365555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:13.373452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-42946e47-d82c-4528-93e0-0c64a769fa98 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088879 Sep 19 11:45:13.374020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1199/2366] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:13.905556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:13.906178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:13.912188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:13.912673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:13.913379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:13.914077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:13.914538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:13.914966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:14.033353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:14.041620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4af03977-ffc5-491e-a653-fa77fcbe185b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.227106 Sep 19 11:45:14.042228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1168/2367] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:14.396635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:14.397185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:14.403756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:14.404241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:14.404688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:14.405371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:14.405825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:14.406251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:14.469961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:14.478366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b79b9f06-aff8-49e2-b8c4-be093b59a525 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085744 Sep 19 11:45:14.478943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1200/2368] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:15.064512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:15.065113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:15.072617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:15.073342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:15.073973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:15.074864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:15.075504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:15.076120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:15.160245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:15.168626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-585e1704-2135-4b72-85cf-03aa097cbe1b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.107994 Sep 19 11:45:15.169188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1169/2369] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:15.502016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:15.502678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:15.509769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:15.510256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:15.510696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:15.511428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:15.511887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:15.512316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:15.589128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:15.597996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9be92f1b-26b3-43fe-91b5-a4f3bbe80595 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.099816 Sep 19 11:45:15.598561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1201/2370] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:16.192591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:16.193182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:16.199644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:16.200128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:16.200567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:16.201245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:16.201702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:16.202129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:16.262607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:16.271548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-683d151c-ede6-4c60-886d-668839c039b3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082162 Sep 19 11:45:16.272127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1170/2371] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:16.621766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:16.622373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:16.628869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:16.629355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:16.629795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:16.631163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:16.631653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:16.632083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:16.696130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:16.704071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-16227322-cf1c-46a6-87ac-a9a166113914 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086244 Sep 19 11:45:16.704642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1202/2372] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:17.294567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:17.295930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:17.303238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:17.303760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:17.304482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:17.305174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:17.305628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:17.306053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:17.366541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:17.374799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-79e125ce-dde8-479f-a3b6-1b5139423202 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084157 Sep 19 11:45:17.375318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1171/2373] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:17.728651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:17.729183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:17.735599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:17.736084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:17.736524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:17.737216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:17.737670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:17.738097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:17.810699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:17.819142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-74c50ce7-5cc1-424b-a146-6f3ca5867c51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.095139 Sep 19 11:45:17.819736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1203/2374] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:18.398153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:18.398959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:18.405612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:18.406104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:18.406553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:18.407292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:18.407761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:18.408193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:18.470770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:18.479805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8247e1dd-97bf-4ea0-8175-2caadefbaa5b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086183 Sep 19 11:45:18.480367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1172/2375] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:18.841900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:18.842496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:18.849009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:18.849490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:18.849928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:18.850613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:18.851068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:18.851522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:18.915054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:18.922849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e79b99cf-fdee-4cc0-97ee-552725a23fe3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084903 Sep 19 11:45:18.923451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1204/2376] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:19.502559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:19.503195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:19.509839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:19.510315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:19.510752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:19.511455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:19.511906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:19.512333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:19.572205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:19.580449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bef0386d-1db9-43d6-8c21-739e537956da tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082032 Sep 19 11:45:19.581013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1173/2377] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:19.945689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:19.946330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:19.952848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:19.953334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:19.953776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:19.954462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:19.954923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:19.955386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:20.015883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:20.024332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3c60e3f6-2a43-4859-83f0-8da4280bef09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082551 Sep 19 11:45:20.024906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1205/2378] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:20.603578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:20.604182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:20.610593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:20.611081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:20.611556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:20.612251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:20.612712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:20.613144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:20.677008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:20.685590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a3d209e2-e8aa-437e-b352-f1c777589c7d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085868 Sep 19 11:45:20.686161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1174/2379] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:21.047776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:21.048387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:21.055044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:21.055557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:21.055995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:21.056678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:21.057133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:21.057559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:21.125035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:21.133451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bfa254e0-902e-4bcf-8760-cc5b369dd2d3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.089589 Sep 19 11:45:21.134009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1206/2380] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:21 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:21.708444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:21.709008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:21.716149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:21.716834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:21.717432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:21.718149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:21.718611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:21.719046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:21.784250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:21.793718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b48835d4-ebae-4c74-8f86-75ed9fcc6fe1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089285 Sep 19 11:45:21.794293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1175/2381] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:22.156203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:22.156808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:22.163964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:22.164445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:22.164876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:22.165561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:22.166006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:22.166423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:22.227094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:22.234858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-81c67235-d50e-402a-b75c-e9e2fee16a51 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082544 Sep 19 11:45:22.235456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1207/2382] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:22.817306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:22.817920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:22.825063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:22.825544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:22.825979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:22.826663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:22.827116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:22.827563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:22.889923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:22.898106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-89311c16-b4b0-4c0d-ab7b-a493d75e4dde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084669 Sep 19 11:45:22.898670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1176/2383] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:23.257723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:23.258336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:23.264820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:23.265303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:23.265747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:23.266437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:23.266896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:23.267390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:23.331199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:23.338921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-67bbcc97-fedf-484e-9452-dddc8ac99fa0 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085190 Sep 19 11:45:23.339527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1208/2384] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:23.920925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:23.921562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:23.928313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:23.928840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:23.929546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:23.930233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:23.930691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:23.931124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:23.991948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:24.000084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-12c837a7-dc4f-4993-a634-e0cce3632493 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083014 Sep 19 11:45:24.000652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1177/2385] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:24.362542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:24.363190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:24.370099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:24.370593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:24.371029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:24.371757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:24.372618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:24.372618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:24.434108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:24.441927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8047b00e-366f-4a42-b0e5-a5d3e13a5f90 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083317 Sep 19 11:45:24.442491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1209/2386] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:25.029660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:25.030284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:25.036964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:25.037457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:25.038509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:25.039242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:25.039709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:25.040140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:25.101929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:25.110312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5e83d1cd-5e38-41c7-b63c-ff3aed846005 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084430 Sep 19 11:45:25.111092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1178/2387] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:25.465904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:25.466437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:25.473047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:25.473542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:25.473981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:25.474674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:25.475131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:25.475595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:25.542082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:25.553210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-df0ee316-59c5-4b80-a3e4-f64c4c0ebaeb tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.088025 Sep 19 11:45:25.553210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1210/2388] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:26.132811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:26.133421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:26.140083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:26.140609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:26.141049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:26.141777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:26.142238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:26.142677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:26.203987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:26.212183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-646329e0-e635-4e3c-92de-ab40579627b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083326 Sep 19 11:45:26.212759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1179/2389] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:26.572848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:26.573442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:26.575476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:45:26.575689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:45:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd (ip 10.222.0.78) !!! Sep 19 11:45:26.582175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:26.582658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:26.583099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:26.583828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:26.584280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:26.585239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:26.646635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:26.654922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bf89bdb0-2f85-4730-b93b-46aea829ddd4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086034 Sep 19 11:45:26.655612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1211/2390] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:27.235436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:27.236322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:27.244089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:27.244580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:27.245026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:27.245725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:27.246187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:27.246617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:27.309449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:27.317842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-abc5a3cd-761a-41c9-8501-56537b197f51 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086319 Sep 19 11:45:27.318416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1180/2391] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:27.679313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:27.679947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:27.686364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:27.687668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:27.687668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:27.687961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:27.688408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:27.688830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:27.752696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:27.760474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3be0137a-42a6-449d-be46-a19333a82a17 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085798 Sep 19 11:45:27.761045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1212/2392] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:28.341660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:28.342222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:28.348670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:28.349159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:28.349601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:28.350304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:28.350764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:28.351211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:28.415143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:28.423507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b22f823-4792-4d3b-a367-e83d4d010f26 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085786 Sep 19 11:45:28.424087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1181/2393] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:28.782592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:28.783220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:28.789708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:28.790185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:28.790615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:28.791341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:28.791786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:28.792204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:28.855588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:28.863743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fc61ade2-2202-4f42-800f-a1ea7c7051a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085011 Sep 19 11:45:28.864313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1213/2394] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:29.447319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:29.447850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:29.449829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:45:29.449977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:45:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 (ip 10.222.0.78) !!! Sep 19 11:45:29.457655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:29.458144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:29.458596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:29.459326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:29.459790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:29.460725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:29.523117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:29.531388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e7a2b9ea-4685-49ff-bf74-5e357a5760d6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088141 Sep 19 11:45:29.531960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1182/2395] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:29.886833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:29.887464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:29.893988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:29.894508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:29.894947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:29.895677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:29.896137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:29.896564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:29.961669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:29.969492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-10105ef1-80a6-4ca3-8925-28c7df90c57e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086536 Sep 19 11:45:29.970060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1214/2396] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:30.555302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:30.555933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:30.562563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:30.563086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:30.563581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:30.564272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:30.564729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:30.565192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:30.627516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:30.629699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:30.636938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e2dc7e98-54eb-4e90-b962-7ed38500ce8e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085959 Sep 19 11:45:30.643088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1183/2397] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:30.992701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:30.993252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:30.999734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:31.000212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:31.000651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:31.001331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:31.001785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:31.002215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:31.064087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:31.073018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ab26e593-03a0-43de-87a6-bcf65c93b805 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084840 Sep 19 11:45:31.073601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1215/2398] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:31.659892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:31.660438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:31.667688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:31.668174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:31.668612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:31.669299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:31.669754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:31.670181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:31.731387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:31.739610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-df9ac418-4bbc-41ff-8bc0-eeffd37c5537 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084023 Sep 19 11:45:31.740183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1184/2399] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:32.103847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:32.104470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:32.111013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:32.111543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:32.111977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:32.112672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:32.113123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:32.113540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:32.116395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:32.177876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:32.185836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1486f5e2-e682-4acd-be3b-a8f9affd39c3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085887 Sep 19 11:45:32.186409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1216/2400] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:32 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:32.762727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:32.763371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:32.769830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:32.770318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:32.770759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:32.771487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:32.771947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:32.772378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:32.833155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:32.841876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-877bd422-47c9-4bcd-8b9f-4e72d03f955d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083577 Sep 19 11:45:32.842446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1185/2401] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:33.209305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:33.209917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:33.216350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:33.216837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:33.217277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:33.217965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:33.218423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:33.218858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:33.279839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:33.287849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a411dbc-822c-4126-b1a4-8e4ec8152654 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082372 Sep 19 11:45:33.288372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1217/2402] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:33.865224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:33.866333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:33.873468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:33.873956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:33.874396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:33.875103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:33.875598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:33.876034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:33.938453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:33.946669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7ad478a2-8171-4b6c-954d-d8ac050c1213 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085453 Sep 19 11:45:33.947265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1186/2403] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:34.310992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:34.311639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:34.317839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:34.318324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:34.318766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:34.319487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:34.319942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:34.320406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:34.382694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:34.390611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-65273b1e-16b5-4b04-9b2f-bdd9c2715114 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083538 Sep 19 11:45:34.391234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1218/2404] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:34.970454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:34.971074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:34.978335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:34.978820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:34.979283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:34.979974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:34.980427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:34.980851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:35.044432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:35.052647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4fde3744-2961-4ded-bd4c-1afca49c10c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086072 Sep 19 11:45:35.053222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1187/2405] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:35.413907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:35.414508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:35.421561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:35.422045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:35.422476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:35.423161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:35.423628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:35.424050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:35.484670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:35.492483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c6dae40f-866d-4c01-993e-2625443291c4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082378 Sep 19 11:45:35.493069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1219/2406] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:36.075921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:36.076522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:36.082889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:36.083403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:36.083835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:36.084515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:36.084964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:36.085415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:36.147587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:36.156307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-967d67ab-1bfe-44f8-8838-0fa79ec0d12f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084306 Sep 19 11:45:36.156865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1188/2407] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:36.515280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:36.515901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:36.522370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:36.522859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:36.523337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:36.524028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:36.524486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:36.524916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:36.589935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:36.597860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a8e59cf8-4b02-42d3-99f5-36ee2eb99a9a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086518 Sep 19 11:45:36.598435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1220/2408] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:37.179087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:37.179731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:37.186706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:37.187216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:37.187662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:37.188358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:37.188816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:37.189239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:37.253095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:37.261317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c7a5ffcf-1278-42b3-91fd-18fb2d9418b1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086432 Sep 19 11:45:37.261888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1189/2409] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:37.620843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:37.637018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:37.637018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:37.637018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:37.637018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:37.637542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:37.637542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:37.637542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:37.694072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:37.701760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c7c60e50-5d75-479d-95f0-c892f69f4b57 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084832 Sep 19 11:45:37.702328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1221/2410] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:38.284822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:38.285413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:38.291936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:38.292417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:38.292881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:38.293569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:38.294019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:38.294444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:38.355641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:38.363698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-67535a7f-2fee-43e1-a861-0e2e6e95f668 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082830 Sep 19 11:45:38.364262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1190/2411] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:38 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:38.724500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:38.725087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:38.732055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:38.732569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:38.733001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:38.733676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:38.734122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:38.734539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:38.797475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:38.805439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3f66af7b-750f-45bd-a594-2addae206e95 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084821 Sep 19 11:45:38.806626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1222/2412] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:39.387713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:39.388258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:39.394473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:39.394970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:39.395454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:39.396133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:39.396594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:39.397095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:39.457574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:39.465781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a6c7bf30-f4e8-4ffe-b141-9ae1d041c489 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082706 Sep 19 11:45:39.466348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1191/2413] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:39.828580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:39.829185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:39.831508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=56 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:39.836160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:39.837218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:39.837600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:39.838272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:39.838719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:39.839137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:39.899659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:39.907663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b45e279c-2740-4ae7-896c-fbe285e27b7d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082865 Sep 19 11:45:39.908247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1223/2414] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:40.488529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:40.489159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:40.496146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:40.496627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:40.497087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:40.497769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:40.498222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:40.498646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:40.560494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:40.568642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa515def-48bb-4b97-b723-19747d4e0036 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084108 Sep 19 11:45:40.569220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1192/2415] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:40.931989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:40.932601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:40.939048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:40.939573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:40.940022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:40.940712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:40.941177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:40.941606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:41.005361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:41.013259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b7574f07-eacf-448a-b69d-b526335150f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085967 Sep 19 11:45:41.013830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1224/2416] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:41.591581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:41.592191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:41.598561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:41.599045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:41.599520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:41.600204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:41.600657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:41.601082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:41.664195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:41.673242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2c5e59cd-76aa-4e9b-8120-9bf552443bb1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085562 Sep 19 11:45:41.673803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1193/2417] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:42.036145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:42.036764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:42.043958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:42.044459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:42.044901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:42.045608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:42.046066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:42.046498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:42.112104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:42.120117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-88c1909d-c2fe-42d4-83d7-2c034717fcd6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087885 Sep 19 11:45:42.120696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1225/2418] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:42 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:42.696757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:42.697389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:42.699755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:42.704428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:42.704909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:42.705341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:42.706017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:42.706465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:42.706885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:42.769759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:42.778067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dbddfd00-5236-498c-98ad-da6db00cfc81 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085143 Sep 19 11:45:42.778633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1194/2419] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:43.141879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:43.142496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:43.148899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:43.149990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:43.150429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:43.151120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:43.151607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:43.152037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:43.218123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:43.225995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a7673c85-a8fc-4bff-8027-fd8e2c64007c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087960 Sep 19 11:45:43.226578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1226/2420] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:43.800807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:43.801383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:43.808135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:43.809662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:43.809662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:43.809915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:43.810168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:43.810595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:43.872115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:43.880581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fbb98aa0-328a-414a-9cec-7b6ac99dc6f2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083956 Sep 19 11:45:43.881152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1195/2421] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:44.249627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:44.250225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:44.256842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:44.257314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:44.257739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:44.258412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:44.259395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:44.259812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:44.322729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:44.330708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8c96722f-9554-42f6-9d75-89edbcda83a7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085043 Sep 19 11:45:44.331336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1227/2422] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:44.903673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:44.904289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:44.910956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:44.911467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:44.911910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:44.912596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:44.913056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:44.913488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:44.974741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:44.983397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2d834769-720a-476d-a396-3c9dbe38de76 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084066 Sep 19 11:45:44.983978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1196/2423] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:45.354771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:45.355416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:45.361859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:45.362341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:45.362782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:45.363487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:45.363940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:45.364365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:45.427373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:45.435873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2bced8aa-e936-4776-8518-1fd95375bc1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085015 Sep 19 11:45:45.436440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1228/2424] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:46.005925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:46.006576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:46.013020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:46.013507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:46.013953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:46.014650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:46.015110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:46.015567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:46.076955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:46.085378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e3db2a1a-9e56-4a62-b7ff-82a7dc0d40d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083282 Sep 19 11:45:46.085957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1197/2425] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:46.459520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:46.460184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:46.467046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:46.467578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:46.468018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:46.468713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:46.469169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:46.469597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:46.530533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:46.538263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-950d639e-f2f3-4ebe-a42a-1c79c5f98fc4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082871 Sep 19 11:45:46.538833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1229/2426] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:47.109356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:47.110034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:47.116900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:47.117199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:47.117630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:47.119030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:47.119505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:47.119927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:47.180751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:47.188905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d546f1e-91cc-4636-a657-9a8f55040cee tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083611 Sep 19 11:45:47.189468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1198/2427] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:47.560068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:47.560666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:47.566990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:47.567500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:47.567930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:47.568604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:47.569051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:47.569472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:47.632888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:47.640291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-22684868-0217-453f-a9ad-10c12ccbf94d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084074 Sep 19 11:45:47.640854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1230/2428] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:48.212467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:48.213075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:48.219899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:48.220381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:48.220813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:48.221501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:48.221948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:48.222367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:48.284535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:48.293608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-647c5efe-d68c-482e-bcb0-9bf0df291628 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085035 Sep 19 11:45:48.294186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1199/2429] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:45:48.663720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:48.664338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:48.671368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:48.671852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:48.672294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:48.672998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:48.673452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:48.673936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:48.734271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:48.741976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e448702d-6a18-4244-abe6-52973a83ea43 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082531 Sep 19 11:45:48.742537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1231/2430] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:48 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:49.317392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:49.318011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:49.326432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:49.326926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:49.327419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:49.328116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:49.328578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:49.329008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:49.343706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:49.391102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:49.399452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-123c57fb-59a1-41e0-9ee0-529337550c8d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086885 Sep 19 11:45:49.400031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1200/2431] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:49.764661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:49.765276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:49.771707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:49.772193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:49.772632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:49.773316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:49.773769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:49.774699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:49.837784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:49.839971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:45:49.846066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-172b5faf-291f-4c36-8d22-c0e6837c853f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085281 Sep 19 11:45:49.846645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1232/2432] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:50.422245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:50.422814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:50.429642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:50.430131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:50.431084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:50.431807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:50.432266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:50.432693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:50.495543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:50.503820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9596b928-ceb3-4abe-a6ea-34abdcfae8b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085680 Sep 19 11:45:50.504394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1201/2433] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:50.870400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:50.870984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:50.877421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:50.877896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:50.878325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:50.878992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:50.879461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:50.879880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:50.942891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:50.950789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7735caea-fcfd-46c3-b949-d621d42170f8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085243 Sep 19 11:45:50.951395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1233/2434] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:51.527503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:51.528117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:51.534525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:51.535055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:51.535530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:51.536226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:51.536678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:51.537105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:51.599476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:51.607838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-15dd6b45-a7a9-494f-b762-c72afaa45e7c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084829 Sep 19 11:45:51.608397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1202/2435] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:51.973687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:51.974237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:51.980755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:51.981247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:51.981672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:51.982361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:51.982811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:51.983258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:52.048088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:52.056935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6dd8a6a2-6d6d-4e61-a6c7-f797df9c24a9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087234 Sep 19 11:45:52.057513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1234/2436] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:52.630519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:52.631199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:52.637914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:52.638406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:52.638847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:52.639575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:52.640035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:52.640467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:52.701540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:52.709768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d75466a5-88da-466e-abbf-7a493b565565 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083122 Sep 19 11:45:52.710332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1203/2437] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:53.080180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:53.080848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:53.087953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:53.088429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:53.088871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:53.089651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:53.090153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:53.090585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:53.152639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:53.160416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-55cbf754-1fb5-42f8-9fa3-653ff86154aa tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084122 Sep 19 11:45:53.160983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1235/2438] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:53 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:45:53.732822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:53.733461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:53.739900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:53.740386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:53.740818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:53.741507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:53.741962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:53.742390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:53.804658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:53.813017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e248a5d8-d387-4975-860b-4c75f97317b8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084109 Sep 19 11:45:53.813597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1204/2439] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:54.184531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:54.185135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:54.191562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:54.192031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:54.192517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:54.193134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:54.193579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:54.193997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:54.257455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:54.265233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2f2214a0-d2ee-43d8-abe5-51be58a2273b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085048 Sep 19 11:45:54.265812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1236/2440] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:54.835832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:54.836983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:54.843510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:54.843994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:54.844450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:54.845119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:54.845580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:54.846008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:54.906875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:54.915831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30dbd284-3bd0-40a9-96fa-78cf08b51e82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083870 Sep 19 11:45:54.916401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1205/2441] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:55.288282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:55.288892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:55.295548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:55.296035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:55.296476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:55.297164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:55.297650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:55.298081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:55.358538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:55.366358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b4d16dc4-c7ae-4124-a5ce-f720437536fe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081888 Sep 19 11:45:55.366866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1237/2442] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:55.938656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:55.939325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:55.946351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:55.946832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:55.947298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:55.947975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:55.948423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:55.948842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:56.010294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:56.018438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cb83fbd9-6902-4dce-8489-4340e6505d57 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083629 Sep 19 11:45:56.018998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1206/2443] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:56.388968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:56.389578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:56.396451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:56.396935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:56.397837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:56.398532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:56.399552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:56.399983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:56.464540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:56.472225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3ed2bd10-a252-460b-bbfe-8ec6a4483fbe tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087131 Sep 19 11:45:56.472791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1238/2444] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:57.041862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:57.042506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:57.048976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:57.049464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:57.049899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:57.050589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:57.051049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:57.051507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:57.115220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:57.124079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eae855bc-b2c3-4678-b08d-cb2b95828f8a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086177 Sep 19 11:45:57.124647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1207/2445] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:57.496569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:57.497156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:57.503610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:57.504118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:57.504555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:57.505277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:57.506217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:57.506429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:57.569789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:57.577477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-43398db1-2f4b-468f-b6b6-a9c511912d1a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085447 Sep 19 11:45:57.578051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1239/2446] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:58.147305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:58.147917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:58.154320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:58.154797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:58.155270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:58.155952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:58.156405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:58.156831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:58.217243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:58.225365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cc374121-9528-4997-ab29-12e697bd98d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082002 Sep 19 11:45:58.225937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1208/2447] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:58.600112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:58.600733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:58.607040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:58.607551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:58.607981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:58.608654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:58.609113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:58.609529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:58.671905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:58.679943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d80e301f-fa20-4139-ab3d-6027e9abb745 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083688 Sep 19 11:45:58.681035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1240/2448] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:59.249362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:59.249972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:59.256391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:59.256868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:59.257302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:59.257993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:59.258449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:59.258870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:59.323529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:59.331878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-830bc5c1-855f-402c-a7d4-315a32968d15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086377 Sep 19 11:45:59.332454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1209/2449] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:59 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:45:59.704271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:45:59.704886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:45:59.711301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:59.711779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:59.712211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:59.712892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:45:59.713343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:45:59.713767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:45:59.773855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:45:59.781533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f461ccdb-05a5-48c2-be9e-80456b832337 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081290 Sep 19 11:45:59.782100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1241/2450] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:45:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:00.355380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:00.356009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:00.362508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:00.362990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:00.363466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:00.364187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:00.364639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:00.365067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:00.426338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:00.435573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-882c9440-b9d6-4026-844b-0f3cc5c782b6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084082 Sep 19 11:46:00.436141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1210/2451] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:00.804329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:00.804964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:00.811982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:00.812465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:00.812902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:00.813585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:00.814041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:00.814465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:00.877302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:00.885074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3d1b79ab-4015-4803-b68c-2160c82a5bbc tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084932 Sep 19 11:46:00.885638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1242/2452] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:01.458856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:01.459567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:01.466621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:01.467108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:01.467593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:01.468314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:01.468780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:01.469208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:01.532289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:01.540659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ac1e47af-80f6-45be-94fd-ace06bb29916 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085734 Sep 19 11:46:01.541232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1211/2453] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:01.908066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:01.908710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:01.915277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:01.915764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:01.916204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:01.916889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:01.917345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:01.917779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:01.979652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:01.987393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-402801da-1319-45b9-9195-eea2cefcba25 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083208 Sep 19 11:46:01.988048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1243/2454] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:02.564266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:02.564879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:02.572520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:02.572999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:02.573432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:02.574121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:02.574568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:02.574989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:02.635198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:02.643347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-99f195fa-5fe3-49fe-83c7-3e33779b9552 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082976 Sep 19 11:46:02.643908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1212/2455] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:03.010146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:03.010793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:03.017237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:03.017714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:03.018150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:03.018836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:03.019328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:03.019756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:03.083203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:03.091540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf2b1d5b-6375-4438-bbc3-13fbb77f489e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085313 Sep 19 11:46:03.092154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1244/2456] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:03.666468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:03.667115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:03.673578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:03.674071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:03.674515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:03.675292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:03.675834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:03.676271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:03.738962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:03.748185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8f02d8ee-c134-4bc0-9b98-9687c87d70ad tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085988 Sep 19 11:46:03.748761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1213/2457] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:04.118304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:04.118304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:04.122183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:04.122667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:04.123102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:04.123828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:04.124283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:04.124703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:04.198319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:04.206399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-24554671-3c17-41a9-8715-ac92a613322e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.095924 Sep 19 11:46:04.206942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1245/2458] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:04 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:04.770888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:04.771549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:04.778571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:04.779059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:04.779535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:04.780241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:04.780703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:04.781132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:04.847449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:04.856730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7374c4e1-4ae4-4fc5-b332-75f8c42a847d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089745 Sep 19 11:46:04.857313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1214/2459] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:05.229330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:05.229942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:05.236073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:05.236565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:05.237001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:05.237690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:05.238152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:05.238584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:05.303645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:05.312027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ff140da8-c5b9-4551-9652-085d5607afb5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086608 Sep 19 11:46:05.312596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1246/2460] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:05.879225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:05.879780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:05.886203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:05.886682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:05.887114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:05.887820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:05.888271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:05.888691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:05.949956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:05.958141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-11b9b8d4-eb8f-4208-bffb-612724959d63 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082881 Sep 19 11:46:05.958706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1215/2461] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:06.335064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:06.335703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:06.342541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:06.343024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:06.343515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:06.344205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:06.344666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:06.345092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:06.405829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:06.413658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fa9d1bfd-2c3a-47e3-baa7-e1e69c98d85c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082674 Sep 19 11:46:06.414230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1247/2462] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:06.980870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:06.981465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:06.988082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:06.988572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:06.989014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:06.989710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:06.990168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:06.990599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:07.051414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:07.060390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9de41bcf-a42e-49c6-be70-c0cb4b98ade7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083462 Sep 19 11:46:07.060955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1216/2463] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:07.437461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:07.438077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:07.444589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:07.445078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:07.445518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:07.446206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:07.446661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:07.447091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:07.509106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:07.517099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4788b2e8-a9c6-4d39-9c81-7264e2264bb9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083542 Sep 19 11:46:07.517700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1248/2464] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:08.084359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:08.084974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:08.092164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:08.092652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:08.093095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:08.093827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:08.094294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:08.094722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:08.097311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:08.158717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:08.166914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8b63144c-ba14-4a5b-b643-e109ba8193c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086468 Sep 19 11:46:08.167527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1217/2465] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:08.539710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:08.540385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:08.546831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:08.547356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:08.547795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:08.548483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:08.548940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:08.549372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:08.564917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:08.612268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:08.620655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9f2b10a7-922a-4a48-8d37-1dba7420a57a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084851 Sep 19 11:46:08.621245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1249/2466] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:09.189784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:09.190398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:09.196426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:09.197466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:09.197906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:09.198605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:09.199062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:09.199519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:09.258499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:09.267398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7bc6a3ea-b9d5-4a95-8ca0-6c28dc9520b4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.081589 Sep 19 11:46:09.267970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1218/2467] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:09.642915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:09.643549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:09.649965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:09.650447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:09.650883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:09.651595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:09.652049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:09.652474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:09.715299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:09.723016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4b1c2807-40d1-4e59-96e9-fc4635787d07 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083909 Sep 19 11:46:09.723637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1250/2468] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:10.290130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:10.290757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:10.297391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:10.297868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:10.298307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:10.298990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:10.299479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:10.299908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:10.364029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:10.369340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a352720b-a483-4104-bb61-e30165eca92d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083043 Sep 19 11:46:10.369905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1219/2469] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:10.746663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:10.747232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:10.749481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=56 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:10.754259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:10.754740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:10.755190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:10.755888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:10.756339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:10.756763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:10.818935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:10.827990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-13cbe5e5-1fcf-4019-8a3a-a0e130b172dd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085780 Sep 19 11:46:10.828554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1251/2470] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:11.392059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:11.392674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:11.399893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:11.400379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:11.400826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:11.401522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:11.401976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:11.402407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:11.466359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:11.474804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-efb23a15-0596-4794-8319-f461608a37bb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086683 Sep 19 11:46:11.475517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1220/2471] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:11.850557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:11.851209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:11.858255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:11.858739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:11.859200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:11.859914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:11.860376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:11.860810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:11.971752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:11.980802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1765f0f-2951-40e1-b9b3-4b7daaf6f20a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.134060 Sep 19 11:46:11.981377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1252/2472] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:12.497961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:12.498505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:12.504950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:12.505438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:12.505874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:12.506554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:12.507006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:12.507459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:12.570719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:12.579539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-02577d78-8d9c-4050-b11c-78c9f1e2d3d1 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085553 Sep 19 11:46:12.580110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1221/2473] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:13.004180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:13.004790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:13.011908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:13.012392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:13.012827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:13.013512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:13.013968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:13.014394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:13.074410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:13.082216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4f9d9322-c045-463c-8e43-468f10786353 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081881 Sep 19 11:46:13.082776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1253/2474] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:13.602073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:13.603393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:13.605671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:13.610370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:13.610851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:13.611325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:13.612009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:13.612471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:13.612903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:13.674480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:13.683209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bf459df6-466e-446b-acfb-013d55b21b1e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084982 Sep 19 11:46:13.683791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1222/2475] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:14.104271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:14.104890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:14.111906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:14.112400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:14.112840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:14.113543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:14.114007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:14.114441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:14.179491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:14.187221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a9b5b902-e30d-488d-9e95-670092717554 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086794 Sep 19 11:46:14.187787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1254/2476] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:14 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:14.705950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:14.706502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:14.712834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:14.713311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:14.713742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:14.714413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:14.714860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:14.715304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:14.779952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:14.788212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e0dc9064-caa8-42d2-8e28-ba3cabb09390 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086208 Sep 19 11:46:14.788793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1223/2477] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:15.209977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:15.210663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:15.217362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:15.217863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:15.218303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:15.219003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:15.219490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:15.219917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:15.512526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:15.520506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b783af18-486d-4c0f-8116-74bbe566ea82 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.314460 Sep 19 11:46:15.521384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1255/2478] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:15 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:15.812687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:15.813232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:15.819699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:15.820182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:15.820609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:15.821317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:15.821771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:15.822193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:15.885558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:15.893791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a500bf62-fd06-4fe6-8355-523bbea2c913 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084999 Sep 19 11:46:15.894367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1224/2479] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:16.543473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:16.544078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:16.550494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:16.550971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:16.551440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:16.552375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:16.552828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:16.553251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:16.614385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:16.622679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1d0bb8ca-c244-416d-aea3-d96229b973f7 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083084 Sep 19 11:46:16.623267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1256/2480] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:16 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:16.917581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:16.918125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:16.924583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:16.925065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:16.925504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:16.926193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:16.926653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:16.927357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:16.988932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:16.997829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-994af6df-95ef-42a8-97ea-aff4bfee6fbc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084841 Sep 19 11:46:16.998404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1225/2481] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:17.645707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:17.646321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:17.652717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:17.653194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:17.653623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:17.654303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:17.654750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:17.655190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:17.716653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:17.724504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1c0dae41-a3df-4525-873c-361aba73aa20 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082642 Sep 19 11:46:17.725072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1257/2482] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:17 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:18.020354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:18.021043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:18.027779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:18.028270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:18.028718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:18.029413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:18.029865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:18.030295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:18.093891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:18.102071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc2e771a-c5fc-496d-b79c-c9b9203ae856 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085663 Sep 19 11:46:18.103385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1226/2483] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:18.747779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:18.748397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:18.754819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:18.755339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:18.755779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:18.756461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:18.756916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:18.757344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:18.817886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:18.826281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-549e63f0-505b-4b83-b44b-d2bde8e60d32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082429 Sep 19 11:46:18.826852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1258/2484] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:18 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:19.125987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:19.126596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:19.133140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:19.134344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:19.134817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:19.135537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:19.135991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:19.136412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:19.199374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:19.208672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b5734d6d-b6b6-49e7-9da5-a34c34983150 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086498 Sep 19 11:46:19.209250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1227/2485] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:19.850571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:19.851123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:19.857594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:19.858079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:19.858518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:19.859224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:19.859690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:19.860117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:19.926165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:19.932472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6895fb79-01a6-4513-b4d8-9dc7d06d7ebd tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085825 Sep 19 11:46:19.933054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1259/2486] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:19 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:20.232783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:20.233369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:20.239800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:20.240258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:20.240689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:20.241364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:20.241813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:20.242230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:20.305240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:20.316558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-89d07f5f-6834-40e9-ac26-d80da69a5bde tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087712 Sep 19 11:46:20.317134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1228/2487] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:20 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:20.955336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:20.955923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:20.963540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:20.964026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:20.964462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:20.965150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:20.965603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:20.966024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:21.028296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:21.036537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-caa64de3-a9e8-4532-b12b-0d608221b688 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085119 Sep 19 11:46:21.037449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1260/2488] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:20 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:21.340439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:21.341054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:21.347565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:21.348058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:21.348503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:21.349198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:21.349658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:21.350090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:21.410863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:21.419722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d9a936d5-c1de-4988-9da3-db2eb2ad1b88 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083128 Sep 19 11:46:21.420301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1229/2489] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:46:22.060229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:22.060883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:22.067315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:22.067801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:22.068241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:22.068960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:22.069420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:22.069849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:22.130683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:22.139419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f6d89e99-896a-4754-8e42-620b2a0bbd09 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083567 Sep 19 11:46:22.140037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1261/2490] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:22 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:22.444123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:22.444731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:22.451252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:22.451739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:22.452179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:22.452867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:22.453325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:22.453753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:22.516517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:22.524657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3bb2b430-b3ca-4554-bed9-a47e8986878f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084693 Sep 19 11:46:22.525224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1230/2491] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:46:23.162421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:23.163039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:23.169447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:23.169936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:23.170376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:23.171083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:23.171571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:23.171998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:23.232408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:23.240111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eda2a044-d3fd-4147-afcc-e4c6cd605898 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081600 Sep 19 11:46:23.240684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1262/2492] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:23 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:23.548197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:23.548813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:23.555593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:23.556076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:23.557278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:23.557963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:23.558419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:23.558847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:23.621189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:23.629329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-55a3bb75-690a-4279-8555-d29ace0b1830 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085073 Sep 19 11:46:23.629895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1231/2493] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:24.264304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:24.264911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:24.271349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:24.271822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:24.272250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:24.272927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:24.273374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:24.273791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:24.340864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:24.349293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-31c8bbff-9632-498a-897f-1bf02e1a15f5 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.089567 Sep 19 11:46:24.349879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1263/2494] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:24 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:24.652607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:24.653223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:24.659735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:24.660219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:24.660658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:24.661344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:24.661798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:24.662223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:24.725276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:24.734019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3c2b0eed-709c-4d9c-8470-2c6b51e40c15 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085271 Sep 19 11:46:24.734593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1232/2495] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:25.372737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:25.373298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:25.379834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:25.380309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:25.380743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:25.381418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:25.381869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:25.382291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:25.443485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:25.451371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-feb5f1af-d8d5-49c3-bc80-779a561cdae4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083120 Sep 19 11:46:25.451929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1264/2496] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:25 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:25.757709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:25.758325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:25.765804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:25.766287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:25.766725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:25.767438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:25.767895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:25.768322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:25.829879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:25.832056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:25.838737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-949e38c7-dfbb-4c78-b72a-56f8d63695f0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085281 Sep 19 11:46:25.839344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1233/2497] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:26.474161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:26.474705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:26.481828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:26.482314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:26.482760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:26.483486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:26.483945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:26.484373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:26.546737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:26.554800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d1bdc502-d682-41a3-b80b-78ab526a63e9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084622 Sep 19 11:46:26.555398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1265/2498] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:26 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:26.862294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:26.862910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:26.870826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:26.871349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:26.871794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:26.872487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:26.872949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:26.873381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:26.941870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:26.950258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cc02e759-d83f-49ce-b6b1-98d7925cf695 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.092475 Sep 19 11:46:26.950829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1234/2499] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:46:27.577932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:27.578538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:27.584998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:27.585475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:27.585910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:27.586586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:27.587038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:27.587487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:27.591335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:27.649617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:27.657374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8c39369e-3b61-4663-8a27-bb4c1e0147a6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083275 Sep 19 11:46:27.657933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1266/2500] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:27 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:27.973161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:27.973733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:27.979980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:27.980467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:27.980902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:27.981594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:27.982049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:27.982482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:28.043903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:28.052765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-be95dc7b-77c2-4790-b265-b66c3174bdd9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083555 Sep 19 11:46:28.053345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1235/2501] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:27 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:28.680324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:28.680915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:28.687369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:28.687853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:28.688292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:28.689122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:28.689429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:28.689870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:28.750134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:28.757905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6ad17032-0b9d-4df6-989f-8be16e419380 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081762 Sep 19 11:46:28.758465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1267/2502] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:28 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:29.076592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:29.077201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:29.083621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:29.084096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:29.084523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:29.085201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:29.085652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:29.086071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:29.150571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:29.159655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-55285f6a-3737-4336-b496-27a8b1440270 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087430 Sep 19 11:46:29.160229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1236/2503] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:29.781647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:29.782265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:29.788773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:29.789258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:29.789693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:29.790380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:29.790837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:29.791294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:29.852170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:29.859855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-674af942-e881-44b7-8a46-44b173ecf67e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082135 Sep 19 11:46:29.860419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1268/2504] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:29 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:30.182591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:30.183332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:30.189652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:30.190141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:30.190579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:30.191293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:30.191754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:30.192185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:30.252634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:30.261581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-380882a8-5700-48d2-9007-655ea6387ea8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083355 Sep 19 11:46:30.262157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1237/2505] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:30.882984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:30.883602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:30.889961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:30.890438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:30.890868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:30.891581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:30.892032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:30.892452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:30.954642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:30.962593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-74f6469c-5476-4633-a3b5-082b670a596b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083496 Sep 19 11:46:30.963709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1269/2506] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:30 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:31.284233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:31.284848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:31.291511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:31.292003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:31.292444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:31.293134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:31.293601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:31.294030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:31.358034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:31.366417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bfe63646-5e02-4459-820e-53f5db14d2a6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086054 Sep 19 11:46:31.366992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1238/2507] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:31.986244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:31.986895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:31.993689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:31.994671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:31.995122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:31.995844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:31.996302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:31.996731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:32.060043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:32.067892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a6fdfcf8-d64f-4fee-abc5-07686a854997 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085648 Sep 19 11:46:32.068463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1270/2508] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:31 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:32.389301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:32.389912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:32.396481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:32.396974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:32.397410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:32.398102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:32.398560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:32.398985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:32.460285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:32.468466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-13b214a9-ef4c-4781-b7ae-aebea6cb4a03 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083079 Sep 19 11:46:32.469040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1239/2509] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:33.091923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:33.092538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:33.100800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:33.101291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:33.101728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:33.102426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:33.102873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:33.103327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:33.169334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:33.177326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-06593526-3d7b-4ddc-a536-72b6eafaec0f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.089832 Sep 19 11:46:33.177907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1271/2510] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:33 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:33.492002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:33.492580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:33.499065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:33.499577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:33.500015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:33.500707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:33.501225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:33.501588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:33.567505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:33.575995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-afdc460b-056d-43b1-889d-6a5909ede1f4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087912 Sep 19 11:46:33.576587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1240/2511] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:34.200379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:34.200990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:34.207441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:34.207925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:34.208359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:34.209045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:34.209503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:34.209925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:34.270378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:34.278831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-920a4189-b36d-4bdf-a096-0166cc7f9389 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082350 Sep 19 11:46:34.279441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1272/2512] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:34 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:34.598772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:34.599428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:34.605740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:34.606212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:34.606642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:34.607350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:34.607800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:34.608218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:34.668998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:34.677544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e89fb2d3-0d57-430e-9f12-65965d42ee3a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082589 Sep 19 11:46:34.678110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1241/2513] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:35.302554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:35.303184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:35.310517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:35.311042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:35.311469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:35.312162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:35.312619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:35.313049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:35.373336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:35.380999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce6489b7-2630-425b-8fd3-6fc4ffa6254f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082700 Sep 19 11:46:35.382000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1273/2514] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:35 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:35.700480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:35.701044 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:35.707533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:35.708022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:35.708465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:35.709156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:35.709620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:35.710046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:35.774119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:35.782822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a4fa9953-5455-4a0e-b237-2334f359c0c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086448 Sep 19 11:46:35.783416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1242/2515] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:36.415145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:36.416357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:36.424463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:36.424938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:36.425371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:36.426059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:36.426780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:36.427223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:36.488312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:36.496036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-52a06464-bf1d-4f26-801e-f93c03bb2e2c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.094800 Sep 19 11:46:36.496601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1274/2516] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:36 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:36.806443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:36.807091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:36.813641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:36.814128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:36.814570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:36.815291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:36.815751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:36.816177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:36.876599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:36.885321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7a64c455-995c-483e-ae5c-b5bf5206ea98 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082309 Sep 19 11:46:36.885896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1243/2517] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:37.517789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:37.518398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:37.524916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:37.525399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:37.525841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:37.526530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:37.526992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:37.527449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:37.588674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:37.596366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c433b55a-5020-47d6-9810-9af87c125ad4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082438 Sep 19 11:46:37.596937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1275/2518] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:37 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:37.908892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:37.909431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:37.916483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:37.916980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:37.917418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:37.918119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:37.918602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:37.919038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:37.983215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:37.991767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-33bb6b3b-6593-451e-bf4c-1f2ac554fb6b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086744 Sep 19 11:46:37.992236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1244/2519] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:38.619341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:38.619941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:38.626848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:38.627367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:38.627808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:38.628498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:38.628956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:38.629383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:38.690195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:38.697934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-568574e0-030c-43cb-abad-a129d196671a tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082499 Sep 19 11:46:38.699146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1276/2520] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:38 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:39.014266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:39.014882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:39.021315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:39.021806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:39.022247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:39.022951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:39.023437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:39.023869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:39.085942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:39.094145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3ee2586f-c872-428b-ab01-142d06da5ac8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083803 Sep 19 11:46:39.094718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1245/2521] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:39.721418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:39.722036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:39.728507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:39.728994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:39.730096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:39.730801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:39.731287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:39.731724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:39.792606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:39.800440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8232da2b-555a-4316-a6ce-15ef2501a259 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083040 Sep 19 11:46:39.801008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1277/2522] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:39 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:40.117351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:40.117968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:40.125149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:40.125661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:40.126099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:40.126796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:40.127271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:40.127698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:40.192760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:40.201215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff951467-b35d-4719-af71-5f464a5bd507 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087742 Sep 19 11:46:40.201793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1246/2523] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:40.823748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:40.824342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:40.826605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=54 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:40.831258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:40.831739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:40.832169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:40.832843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:40.833293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:40.833713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:40.897619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:40.905325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-21463a8d-cd30-4fc4-9f75-12d98b33c36f tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086048 Sep 19 11:46:40.905889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1278/2524] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:40 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:41.225413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:41.226016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:41.233050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:41.233525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:41.233956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:41.234632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:41.235080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:41.235536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:41.299666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:41.308776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4022886e-d09d-46c3-bf10-42912d8d9023 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087541 Sep 19 11:46:41.309343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1247/2525] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:41.928556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:41.929112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:41.935606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:41.936080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:41.936511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:41.937183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:41.937634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:41.938049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:41.999100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:42.006879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9accdd6-3f67-47ae-8f73-ffec42f4452b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082540 Sep 19 11:46:42.010039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1279/2526] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:41 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:42.331287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:42.331886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:42.338196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:42.338668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:42.339793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:42.340472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:42.340922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:42.341342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:42.405869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:42.414485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-47d4ab49-3b34-484e-ba42-8b19f5c426fa tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086962 Sep 19 11:46:42.415096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1248/2527] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:43.030754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:43.031411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:43.038366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:43.038847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:43.039324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:43.040014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:43.040471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:43.040901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:43.102711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:43.110733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-072e680b-baa0-4bc4-a049-ac018f8e414e tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084368 Sep 19 11:46:43.111532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1280/2528] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:43 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:46:43.440242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:43.440801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:43.447051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:43.447555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:43.447986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:43.449352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:43.449800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:43.450221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:43.511512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:43.519822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f5e184a0-01d2-4e5b-a648-ccc3eacfaccc tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083538 Sep 19 11:46:43.520392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1249/2529] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:44.133906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:44.134510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:44.141029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:44.141512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:44.141951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:44.142637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:44.143094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:44.143554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:44.204800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:44.212528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b9191907-6574-41f0-a470-d5bdced9e433 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082528 Sep 19 11:46:44.213083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1281/2530] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:44 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:44.542505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:44.543120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:44.545455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=56 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:44.550161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:44.550646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:44.551084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:44.552057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:44.552517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:44.552946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:44.567666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:44.616766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:44.625919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a9b01bbd-3599-41b6-9382-0e426c521973 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087358 Sep 19 11:46:44.626493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1250/2531] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:45.236003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:45.236608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:45.243293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:45.243846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:45.244442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:45.246213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:45.246670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:45.247100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:45.312759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:45.314997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:46:45.321222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bdd5d2eb-21e2-490d-8d7e-6ac9bf7d19c8 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.089136 Sep 19 11:46:45.321807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1282/2532] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:45 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:45.649426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:45.650022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:45.657186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:45.657668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:45.658106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:45.658903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:45.659618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:45.660224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:45.728282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:45.737215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b7279251-0511-4b46-8f75-f8fa1af92950 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.091799 Sep 19 11:46:45.737785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1251/2533] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:46.347115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:46.347782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:46.354523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:46.355596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:46.356037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:46.356730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:46.357191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:46.357620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:46.417200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:46.425850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-76aa338f-ec27-478a-b226-0fb5fd233d6d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082992 Sep 19 11:46:46.426691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1283/2534] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:46 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:46.759954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:46.760568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:46.766942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:46.767468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:46.767909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:46.768596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:46.769049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:46.769472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:46.834274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:46.843320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e22c5799-135c-45d6-89d2-b5db37fd117e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087150 Sep 19 11:46:46.843894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1252/2535] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:47.460501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:47.461086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:47.468603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:47.472678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:47.472678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:47.472678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:47.472678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:47.473144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:47.533327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:47.541269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-35d13be6-71bf-4d01-b43d-26d214cecd63 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084673 Sep 19 11:46:47.541840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1284/2536] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:47 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:47.866823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:47.867454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:47.874533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:47.875011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:47.875474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:47.876154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:47.876600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:47.877017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:47.937747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:47.945888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-27d612f6-8d6c-4556-86fd-b19243b79f46 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083025 Sep 19 11:46:47.946458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1253/2537] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:48.563781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:48.564399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:48.571118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:48.571634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:48.572163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:48.572766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:48.573222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:48.573649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:48.635999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:48.644440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eb4c8146-332d-4145-8400-b8d826cb5be4 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084511 Sep 19 11:46:48.645008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1285/2538] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:48 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:48.968765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:48.969347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:48.975793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:48.976269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:48.976708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:48.977406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:48.977862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:48.978287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:49.045095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:49.053615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-73830eab-36ae-438a-80be-0c991d10d18d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088813 Sep 19 11:46:49.054193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1254/2539] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:48 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:46:49.667334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:49.667943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:49.674407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:49.674886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:49.675696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:49.676653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:49.677104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:49.677526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:49.738778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:49.746649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-251437f5-db2d-4d03-a3f1-39516290cd3c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083085 Sep 19 11:46:49.747241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1286/2540] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:49 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:50.077430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:50.078019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:50.084905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:50.085385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:50.085822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:50.086509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:50.086962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:50.087415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:50.149107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:50.157550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9ee78d87-9620-467a-b44b-995d6cd5f5cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084484 Sep 19 11:46:50.158154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1255/2541] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:50.769445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:50.770113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:50.776579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:50.777063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:50.777505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:50.778191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:50.778651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:50.779079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:50.839606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:50.847360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e16e435b-9dd5-4eef-bb57-da35d54c6405 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081767 Sep 19 11:46:50.847927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1287/2542] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:50 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:51.181046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:51.181664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:51.188818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:51.189305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:51.189736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:51.190426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:51.190870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:51.191324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:51.256898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:51.265285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-11adf8af-022d-4c4e-b61b-da10c7c7f2e8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088146 Sep 19 11:46:51.265869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1256/2543] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:46:51.869968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:51.870577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:51.877848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:51.878330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:51.878763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:51.879492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:51.879948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:51.880375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:51.944814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:51.953258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ac9a53c8-5820-476c-9245-7416ce32b300 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.087123 Sep 19 11:46:51.953843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1288/2544] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:51 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:52.288825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:52.289494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:52.296567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:52.297049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:52.297487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:52.298174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:52.298631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:52.299059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:52.363928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:52.372653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8861c9c1-f168-4199-a985-0fa13c6fd8c8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087677 Sep 19 11:46:52.373231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1257/2545] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:52.976955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:52.977600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:52.984188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:52.984669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:52.985108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:52.985795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:52.986253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:52.986690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:53.047305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:53.055123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c0530c35-8edd-44ba-928b-cca43f492dc6 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082139 Sep 19 11:46:53.055709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1289/2546] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:52 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:53.399034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:53.399734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:53.407556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:53.408057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:53.408498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:53.409211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:53.409673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:53.410104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:53.478885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:53.487527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-efd8a5af-d9dc-447d-a1d6-e71b705bc008 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.092310 Sep 19 11:46:53.488104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1258/2547] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:54.077209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:54.077825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:54.084886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:54.085363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:54.085794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:54.086478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:54.086927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:54.087374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:54.150254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:54.158069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-51521a1e-b598-4ff8-a776-f5f6b65b7078 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084773 Sep 19 11:46:54.158639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1290/2548] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:54 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:54.510421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:54.511075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:54.517575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:54.518059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:54.518494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:54.519188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:54.519657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:54.520082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:54.582990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:54.591873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87c2de84-6be4-4fa7-81ef-36155752499d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085317 Sep 19 11:46:54.592478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1259/2549] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:55.182720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:55.183522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:55.190296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:55.190778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:55.191248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:55.191938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:55.192392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:55.192818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:55.253144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:55.260790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c839f7b7-defa-41f1-a03d-044a5e7a3664 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082869 Sep 19 11:46:55.261355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1291/2550] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:55 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:55.615241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:55.615875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:55.622337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:55.622823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:55.623293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:55.623997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:55.624458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:55.624892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:55.691583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:55.700538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f2b1ca88-22a7-47c9-bece-256c482b292f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088963 Sep 19 11:46:55.701116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1260/2551] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:56.284728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:56.285349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:56.291765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:56.292248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:56.292683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:56.293361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:56.293814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:56.294240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:56.355766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:56.363618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-52cb3a04-8f38-4065-baa8-65005c9e8625 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082721 Sep 19 11:46:56.364226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1292/2552] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:56 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:56.723724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:56.724323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:56.730753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:56.731277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:56.731714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:56.732398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:56.732850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:56.733270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:56.796441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:56.804908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4d08671b-2b1c-4948-aadf-2ef86ed5677a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085049 Sep 19 11:46:56.805473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1261/2553] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:57.386451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:57.386984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:57.394690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:57.395194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:57.395642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:57.396343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:57.396902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:57.397339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:57.459101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:57.466817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4b8feee8-2d51-4e77-82ec-f1829cce8dbf tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.084428 Sep 19 11:46:57.467418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1293/2554] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:57 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:57.829206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:57.829800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:57.836365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:57.836844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:57.837276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:57.837960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:57.838410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:57.838833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:57.903195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:57.911848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4c56e577-66d0-4b73-bfd2-a73ac3931b5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086538 Sep 19 11:46:57.912417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1262/2555] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:58.489030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:58.489554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:58.496106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:58.496586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:58.497020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:58.497736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:58.498213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:58.498638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:58.562753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:58.570696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8c4c8eb7-ebde-4e54-8b92-ab25fcf92fb3 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085683 Sep 19 11:46:58.571290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1294/2556] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:58 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:58.940034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:58.940643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:58.947012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:58.947534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:58.947968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:58.948646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:58.949094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:58.949513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:59.011114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:59.020198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-af1a0e2f-c621-4be6-86c4-08961481a712 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083970 Sep 19 11:46:59.020775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1263/2557] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:46:59.594495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:46:59.595100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:46:59.601545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:59.602025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:59.602511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:59.603141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:46:59.603623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:46:59.604048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:46:59.664085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:46:59.672416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1d22ca1f-6aa9-4f44-8239-b0c5fad06333 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082327 Sep 19 11:46:59.672980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1295/2558] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:46:59 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:00.042301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:00.042911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:00.049327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:00.049808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:00.050245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:00.051219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:00.051677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:00.052102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:00.115247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:00.123783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-769d04c7-3de8-4d1c-9b71-82f1064b7940 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085350 Sep 19 11:47:00.124344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1264/2559] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:00.695439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:00.696053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:00.702962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:00.703490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:00.703928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:00.704645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:00.705090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:00.705537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:00.765501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:00.773278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1bc285ea-271d-4df3-a8e7-509424d9d66c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081727 Sep 19 11:47:00.773848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1296/2560] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:00 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:01.146081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:01.146701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:01.154220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:01.154714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:01.155159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:01.155880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:01.156347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:01.156771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:01.222332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:01.230416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4c70cea5-1bae-4a59-9664-8cfb74c141be tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088398 Sep 19 11:47:01.230989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1265/2561] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:01.796547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:01.797093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:01.803735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:01.804234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:01.804665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:01.805338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:01.805781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:01.806199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:01.869171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:01.877002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d75f9404-bf37-4b4d-a42c-7892738dddac tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.085005 Sep 19 11:47:01.877580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1297/2562] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:01 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:02.253449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:02.254059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:02.260531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:02.261019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:02.261461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:02.262151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:02.263112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:02.263569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:02.326611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:02.334806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a5d1441c-e3a4-480d-9934-f141533288e0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085329 Sep 19 11:47:02.335406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1266/2563] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:02.899732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:02.900354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:02.906741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:02.907250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:02.907686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:02.908368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:02.908820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:02.909245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:02.969830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:02.977679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7e924131-eb89-4aaf-871c-85e351fd5d5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081788 Sep 19 11:47:02.978244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1298/2564] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:02 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:03.360054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:03.360668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:03.367110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:03.367626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:03.368066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:03.368753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:03.369211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:03.369637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:03.372246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:03.433715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:03.441755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1aadc166-c6cb-4c0c-9f75-f9e2ae082350 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086229 Sep 19 11:47:03.442331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1267/2565] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:04.000507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:04.001243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:04.007791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:04.008265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:04.008696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:04.009373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:04.009817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:04.010245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:04.025362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:04.072210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:04.080512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1d5ea46-db8b-471a-b552-4c261c03125d tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083950 Sep 19 11:47:04.081076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1299/2566] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:03 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:04.464440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:04.464992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:04.471506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:04.472018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:04.472460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:04.473150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:04.473635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:04.474065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:04.538112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:04.546929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-26634395-0d89-40ed-9f60-bb5de81bf28e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086398 Sep 19 11:47:04.547534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1268/2567] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:05.103150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:05.103785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:05.110513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:05.111007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:05.111474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:05.112178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:05.112636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:05.113064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:05.174993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:05.183073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-03bd285c-2532-42da-8bf8-7b20d4d1cb11 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083959 Sep 19 11:47:05.183662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1300/2568] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:05 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:05.569887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:05.570500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:05.577120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:05.577615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:05.578054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:05.578751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:05.579237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:05.579673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:05.641268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:05.649504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1901d327-1939-4a85-8d4f-a0c6cf4bf5c2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083550 Sep 19 11:47:05.650080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1269/2569] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:06.206389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:06.207000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:06.213519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:06.214088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:06.214527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:06.215249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:06.215710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:06.216703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:06.276984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:06.285607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f3ec48f3-ca5f-4d86-9ac1-03e574caf080 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083339 Sep 19 11:47:06.286181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1301/2570] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:06 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:06.673315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:06.674056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:06.680884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:06.681377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:06.681819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:06.682509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:06.682967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:06.683421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:06.746935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:06.755835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d5f1e7d-e26b-4b69-a7e0-931f52ca886f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086963 Sep 19 11:47:06.756405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1270/2571] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:07.308900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:07.309639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:07.316565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:07.317043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:07.317473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:07.318157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:07.318605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:07.319026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:07.382396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:07.390224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d4ca06f7-9536-4db3-bdd8-5973785b2f9c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.086011 Sep 19 11:47:07.390808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1302/2572] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:07 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:07.779238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:07.779884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:07.786307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:07.786784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:07.787244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:07.787926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:07.788375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:07.788795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:07.849963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:07.858273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5714069b-eff6-4b42-b624-26cc6a569ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083795 Sep 19 11:47:07.858839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1271/2573] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:08.419537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:08.420097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:08.426723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:08.427225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:08.427657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:08.428344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:08.428827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:08.429248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:08.489183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:08.496881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c87e0d56-5e2c-4b9c-bb50-508012928f5c tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.081870 Sep 19 11:47:08.498068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1303/2574] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:08 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:08.882407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:08.883000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:08.890390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:08.890876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:08.891347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:08.892040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:08.892499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:08.892928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:08.957066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:08.965463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-62659ce3-1b10-4a83-b942-c3707a8f2a5c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086919 Sep 19 11:47:08.966650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1272/2575] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:09.520098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:09.520712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:09.527109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:09.527629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:09.528073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:09.528761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:09.529220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:09.529648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:09.592241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:09.600020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a22bdf9a-55ed-4e01-96a9-9d40c60c7b32 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083816 Sep 19 11:47:09.600590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1304/2576] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:09 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:47:09.989213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:09.989971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:09.992064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:47:09.992234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:47:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 (ip 10.222.0.78) !!! Sep 19 11:47:09.998709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:09.999214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:09.999692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:10.000437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:10.000874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:10.001307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:10.068152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:10.077092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fa422920-f20e-48ea-9760-4baf90bc70a3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.091934 Sep 19 11:47:10.077661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1273/2577] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:09 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:10.624443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:10.625068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:10.631524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:10.632009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:10.632451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:10.633209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:10.633632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:10.634043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:10.704889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:10.712805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3a154fbf-863f-4eeb-8113-0e41541f9dca tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.094022 Sep 19 11:47:10.713384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1305/2578] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:10 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:11.099359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:11.100676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:11.107977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:11.108598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:11.109137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:11.110055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:11.110521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:11.110952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:11.176797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:11.185821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-103f4167-5da6-463a-8234-3e5b6528ca3e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.090199 Sep 19 11:47:11.186396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1274/2579] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:11.735429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:11.736020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:11.738352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=56 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:11.743097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:11.743611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:11.744051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:11.744764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:11.745219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:11.745646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:11.806021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:11.814266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-72c72d68-00f2-4089-ba8f-c2b29e842234 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082829 Sep 19 11:47:11.814829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1306/2580] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:11 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:12.209380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:12.209986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:12.216394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:12.216883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:12.217327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:12.218019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:12.218649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:12.219031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:12.280696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:12.288959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0579c25f-6d75-4129-b13d-d7b8ef3ed149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083578 Sep 19 11:47:12.289513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1275/2581] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:12.836696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:12.837300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:12.844442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:12.844928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:12.845369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:12.846051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:12.846511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:12.846940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:12.908941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:12.916674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c3d5ce05-afe2-4b81-9a31-0f9ed10c03b9 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.083872 Sep 19 11:47:12.917246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1307/2582] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:12 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:13.313235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:13.313855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:13.320456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:13.320948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:13.321387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:13.322077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:13.322530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:13.322986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:13.386186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:13.395236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a24941d4-ffde-4045-9d1b-d95d120a7d0f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086348 Sep 19 11:47:13.395823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1276/2583] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:13.939163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:13.939807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] [instance: ba241cb3-089a-4eef-a681-bddf2cb387bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:13.946194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:13.946675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:13.947114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:13.947818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:13.948272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:13.948699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:14.009740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '792178b0829f49c2b5729aeee1805e77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4f82c67c47c243f594cd2bab7ac861aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:14.017462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f8e12d7a-5e04-4b91-853a-4d537d582f3b tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd" status: 200 len: 1219 microversion: 2.1 time: 0.082200 Sep 19 11:47:14.018029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1308/2584] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:13 2022] GET /compute/v2.1/servers/ba241cb3-089a-4eef-a681-bddf2cb387bd => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:14.243660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-71e8379f-b4c6-4cc5-a02e-8aee269bc670 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] Calling method '.version_select at 0x7f4b9a54a160>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:14.337061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-71e8379f-b4c6-4cc5-a02e-8aee269bc670 tempest-TestShelveInstance-839333304 tempest-TestShelveInstance-839333304-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-727516199" status: 202 len: 0 microversion: 2.1 time: 0.097157 Sep 19 11:47:14.337761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1277/2585] 10.222.0.78 () {58 vars in 1251 bytes} [Mon Sep 19 11:47:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-727516199 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:47:14.418060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:14.418669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:14.425794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:14.426275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:14.426707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:14.427422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:14.427874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:14.428296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:14.492840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:14.501224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-423ccfdd-6a6b-4fef-959d-a26ff6de9c49 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087045 Sep 19 11:47:14.511521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1309/2586] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:47:15.525143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:15.525758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:15.527653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=57,nova_api:DELETE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:15.533488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:15.534005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:15.534446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:15.535140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:15.535624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:15.536056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:15.597372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:15.607055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d85e8a9e-1b80-4fca-9061-a017cda720fe tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085665 Sep 19 11:47:15.607920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1278/2587] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:15 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:16.630495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:16.631157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:16.637582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:16.638077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:16.638519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:16.639249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:16.639764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:16.640206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:16.706114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:16.714689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1ac778e5-409d-47fd-8182-4a1db5bbadbb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088491 Sep 19 11:47:16.715283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1310/2588] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:16 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:17.739255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:17.739878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:17.748944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:17.749718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:17.750161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:17.751011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:17.751686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:17.752114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:17.831678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:17.840177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8550e627-b6e1-4e42-bee0-9e552e7f125a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.106151 Sep 19 11:47:17.840755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1279/2589] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:17 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:18.863483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:18.864210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:18.870855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:18.871561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:18.871994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:18.872680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:18.873136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:18.873554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:18.967613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:18.975826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0f784642-7d86-4a9a-b7b0-ab15c3e14d39 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.116221 Sep 19 11:47:18.976402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1311/2590] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:18 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:47:19.998677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:19.999348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:20.007840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:20.008581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:20.009028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:20.009738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:20.010376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:20.010797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:20.297840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:20.306580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-555d91dc-9794-459c-a319-402fa6cbfc82 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.312161 Sep 19 11:47:20.307192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1280/2591] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:19 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:21.333003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:21.334454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:21.347426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:21.347924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:21.349274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:21.350001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:21.350467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:21.350901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:21.450772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:21.461451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-25908d0e-cf23-4639-8596-a3b3fd343186 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.135657 Sep 19 11:47:21.468252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1312/2592] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:21 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:22.489232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:22.489854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:22.499548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:22.500464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:22.501345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:22.503430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:22.504248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:22.505035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:22.574077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:22.585002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4d285f5f-6f09-4c0d-9fa8-fb25977920d4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.097336 Sep 19 11:47:22.585002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1281/2593] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:22 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:23.606867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:23.607731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:23.614661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:23.615162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:23.615634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:23.616354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:23.616817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:23.617251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:23.685449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:23.695060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9eb9c1d8-840c-4642-afef-da4701e32820 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.092965 Sep 19 11:47:23.695685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1313/2594] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:23 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:24.719353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:24.719961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:24.726369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:24.726854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:24.727323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:24.728011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:24.728462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:24.728894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:24.791727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:24.800175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fd633d4e-80ab-4992-8a81-1802c134c9e6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085266 Sep 19 11:47:24.800742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1282/2595] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:24 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:25.826794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:25.827404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:25.834232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:25.834724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:25.835197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:25.835888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:25.836350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:25.836778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:25.902051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:25.910329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a1c93c62-30c1-4fa2-8555-0ec59cc46bcb tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088455 Sep 19 11:47:25.910906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1314/2596] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:25 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:26.932897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:26.933495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:26.940364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:26.940847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:26.941289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:26.941990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:26.942442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:26.942869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:27.003648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:27.012054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bff17a0a-68a0-4525-afd7-f7e0b885b813 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083104 Sep 19 11:47:27.012624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1283/2597] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:26 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:28.035661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:28.036275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:28.042794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:28.043309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:28.043749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:28.044438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:28.044893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:28.045965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:28.109424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:28.118272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f9c60ab1-53ca-45b0-9c65-978a034debed tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086406 Sep 19 11:47:28.118855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1315/2598] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:28 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:29.141360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:29.141981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:29.148493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:29.148968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:29.149396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:29.150076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:29.150526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:29.150951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:29.213973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:29.216160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:29.222844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1c0e971f-7478-48da-9497-62ba061fc34a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085392 Sep 19 11:47:29.223446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1284/2599] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:29 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:30.245920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:30.246511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:30.253279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:30.253768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:30.254201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:30.254894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:30.255373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:30.255793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:30.258399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:30.317959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:30.326092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-403b1dca-ed81-4b57-ac2d-a860cbd4af47 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084046 Sep 19 11:47:30.326682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1316/2600] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:30 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:31.349610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:31.350137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:31.356875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:31.357362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:31.357863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:31.358555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:31.359022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:31.359481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:31.421949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:31.430496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7e6bddc3-a367-4bea-82db-73424597cca2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085273 Sep 19 11:47:31.431094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1285/2601] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:31 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:32.453935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:32.454488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:32.460972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:32.461447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:32.461873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:32.462553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:32.462999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:32.463449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:32.527979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:32.536167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3c67e839-3f50-4111-833f-bef416e63df7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086726 Sep 19 11:47:32.536727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1317/2602] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:32 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:47:33.558997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:33.559575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:33.566106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:33.566592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:33.567033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:33.567761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:33.568220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:33.568646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:33.636065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:33.644787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a5e8715c-03bf-40fc-8253-ded087f1144c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.089745 Sep 19 11:47:33.645374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1286/2603] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:33 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:34.667652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:34.668361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:34.675284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:34.675768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:34.676198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:34.676878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:34.677324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:34.677743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:34.738834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:34.746973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a5701872-e515-491d-9365-02e7d35d771a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083272 Sep 19 11:47:34.747573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1318/2604] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:34 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:35.769804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:35.770415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:35.776924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:35.777411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:35.777849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:35.778538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:35.778996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:35.779535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:35.840332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:35.848617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e0234422-a11b-460d-a070-771ac9f7d688 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082699 Sep 19 11:47:35.849190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1287/2605] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:35 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:36.872070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:36.872680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:36.879304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:36.879797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:36.880251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:36.880948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:36.881403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:36.881835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:36.947286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:36.956907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e5bcd9ab-21fc-4798-8bd5-919e09c91c8f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088628 Sep 19 11:47:36.957508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1319/2606] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:36 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:37.984225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:37.984766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:37.990691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:37.991187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:37.991637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:37.992327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:37.992792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:37.993214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:38.060017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:38.068357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-18337781-4a49-4836-beeb-9581df7454f3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.091725 Sep 19 11:47:38.068923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1288/2607] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:37 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:39.091298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:39.092544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:39.098958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:39.099495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:39.099939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:39.100620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:39.101069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:39.101490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:39.163302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:39.171443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7e6c29ff-9085-4bd6-a1f7-bfc9871fddc7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084015 Sep 19 11:47:39.172012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1320/2608] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:39 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:40.194362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:40.194973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:40.201002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:40.201477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:40.201912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:40.202584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:40.203033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:40.203482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:40.263720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:40.271938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-34891715-cac7-4bd3-bc93-c7cb95cfc776 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.081689 Sep 19 11:47:40.272507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1289/2609] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:40 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:41.295690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:41.296557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:41.305595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:41.308888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:41.309556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:41.310141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:41.310605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:41.311042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:41.373621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:41.382558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85e2a112-eba2-4df7-8e71-9e123531c80c tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.090955 Sep 19 11:47:41.383127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1321/2610] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:41 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:42.405163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:42.405770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:42.412359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:42.412845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:42.413294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:42.413993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:42.414483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:42.414910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:42.479543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:42.488349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-491e1a48-5ae8-455a-bc0b-53550b8685a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087057 Sep 19 11:47:42.488921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1290/2611] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:42 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:43.510965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:43.511621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:43.513945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=32 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:43.519255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:43.519746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:43.520189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:43.520884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:43.521345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:43.521777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:43.584158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:43.592244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d0843b4c-0ef1-4dd7-bef4-fb27ea8f88a5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085279 Sep 19 11:47:43.592801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1322/2612] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:43 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:44.614628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:44.615274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:44.621682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:44.622168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:44.622603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:44.623322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:44.623778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:44.624207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:44.684986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:44.693759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a730838b-6d7e-488e-9a9c-87f1af6af19d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083284 Sep 19 11:47:44.694327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1291/2613] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:44 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:45.715918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:45.716551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:45.723882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:45.724362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:45.724801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:45.725477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:45.725967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:45.726425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:45.788308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:45.798362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c09322c5-67f2-490a-9ce4-c0a188f537d0 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086267 Sep 19 11:47:45.798934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1323/2614] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:45 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:47:46.820697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:46.821315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:46.827914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:46.828399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:46.828839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:46.829529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:46.829982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:46.830406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:46.895229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:46.903448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-365daac9-e6d6-406c-b83c-34ddb13d378f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086602 Sep 19 11:47:46.904011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1292/2615] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:46 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:47.926152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:47.926738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:47.933386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:47.933874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:47.934313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:47.935008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:47.935493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:47.935922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:47.999277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:48.008171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-77d90490-1b7a-4fd8-831b-3fe503fa095b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086191 Sep 19 11:47:48.008783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1324/2616] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:47 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:49.031427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:49.032050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:49.034468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=30 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:47:49.039237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:49.039755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:49.040201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:49.040892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:49.041354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:49.041781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:49.105441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:49.114620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23012e2c-794d-4905-9a5d-97341f587e86 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087182 Sep 19 11:47:49.115222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1293/2617] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:49 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:50.137932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:50.138546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:50.145657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:50.146142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:50.146580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:50.147296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:50.147752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:50.148178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:50.211865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:50.220202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a8c45a7f-a99c-4c5a-bdf0-1e1c791898b9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086082 Sep 19 11:47:50.220785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1325/2618] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:50 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:47:51.242901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:51.243602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:51.250836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:51.251368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:51.251807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:51.252522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:51.252981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:51.253404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:51.319671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:51.327983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5fb03582-2c06-439e-8656-d8e6d87c36f9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.088999 Sep 19 11:47:51.328552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1294/2619] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:51 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:52.351644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:52.352262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:52.358785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:52.359335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:52.359781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:52.360472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:52.360937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:52.361366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:52.424692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:52.433045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-63ec3f96-e3cf-48d8-86ad-1d387dae06a9 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085320 Sep 19 11:47:52.433651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1326/2620] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:52 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:53.457304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:53.458202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:53.466022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:53.466508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:53.466951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:53.467691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:53.468145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:53.469813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:53.532097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:53.540393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6e955bac-45ae-438f-9f84-793de44f0661 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087605 Sep 19 11:47:53.540953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1295/2621] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:53 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:54.562750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:54.563396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:54.569846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:54.570366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:54.570767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:54.571478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:54.571939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:54.572367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:54.634071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:54.642999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-064af8fa-eec4-4507-92d5-538147a348cf tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.084077 Sep 19 11:47:54.643657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1327/2622] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:54 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:55.665609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:55.666257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:55.674037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:55.674535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:55.674977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:55.675710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:55.676172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:55.676602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:55.739463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:55.747668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-20c24fc8-c707-45e4-8f51-e9613014cfa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085947 Sep 19 11:47:55.748234 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1296/2623] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:55 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:56.770977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:56.771778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:56.778323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:56.778811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:56.779292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:56.779992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:56.780451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:56.780879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:56.843919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:56.852226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b7b753c2-edbb-4f6b-9cb8-a791163e84f7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085122 Sep 19 11:47:56.852798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1328/2624] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:56 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:47:57.876104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:57.876634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:57.883235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:57.883738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:57.884172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:57.884864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:57.885321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:57.885743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:57.949664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:57.958731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7e0da29-9426-4241-98d2-134e7b7fd81d tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087158 Sep 19 11:47:57.959347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1297/2625] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:57 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:47:58.981845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:47:58.982463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:47:58.989135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:58.989617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:58.990056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:58.990745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:47:58.991232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:47:58.991664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:47:59.053230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:47:59.064623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bc165822-11f7-41f8-abac-2a846f0e72b2 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086540 Sep 19 11:47:59.065215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1329/2626] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:47:58 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:00.088464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:00.089077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:00.096105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:00.096591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:00.097031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:00.097757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:00.098217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:00.098648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:00.162340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:00.171327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e4b58b28-41cf-4c98-892f-b24c4061e3a8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086603 Sep 19 11:48:00.172607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1298/2627] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:00 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:01.195414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:01.196049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:01.202639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:01.203117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:01.203622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:01.204312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:01.204764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:01.205195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:01.209243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=84 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:01.271799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:01.278706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fd28b073-d94e-49ba-86f9-18cf2fb1069e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087264 Sep 19 11:48:01.279262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1330/2628] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:01 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:02.300753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:02.301367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:02.307841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:02.308321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:02.308755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:02.309438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:02.309888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:02.310311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:02.313331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=86 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:02.373222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:02.381934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7c15a946-4333-42d2-bd7d-dec9050d7149 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085335 Sep 19 11:48:02.382500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1299/2629] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:02 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:03.405684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:03.406887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:03.413353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:03.413837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:03.414282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:03.414977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:03.415484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:03.415915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:03.476993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:03.485257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f9886328-c8a2-4d91-9fe0-cc8465c569ff tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083796 Sep 19 11:48:03.485818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1331/2630] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:03 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:04.508567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:04.509257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:04.516348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:04.516828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:04.517259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:04.517943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:04.518391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:04.518813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:04.582974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:04.591031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ab6fbfd3-7f65-4387-b6dc-84871b16eb2f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.086406 Sep 19 11:48:04.591624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1300/2631] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:04 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:05.613662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:05.614272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:05.620297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:05.620784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:05.621225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:05.621909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:05.622365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:05.622794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:05.683838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:05.693396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3b136ac-8ef2-41f7-a447-5da3cd4b558e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083810 Sep 19 11:48:05.693979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1332/2632] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:05 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:06.716725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:06.717331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:06.724236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:06.724714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:06.725147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:06.725823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:06.726265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:06.726684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:06.789487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:06.798598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c3251831-0cb5-4385-b132-46a0d802a1d7 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085468 Sep 19 11:48:06.799182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1301/2633] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:06 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:07.821394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:07.822009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:07.828514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:07.828991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:07.829507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:07.830237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:07.830698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:07.831211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:07.895002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:07.904454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ea6a8ec1-6c86-4334-a3dc-6ce870059904 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087149 Sep 19 11:48:07.905045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1333/2634] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:07 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:08.935559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:08.936164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:08.943668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:08.944151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:08.944587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:08.945277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:08.945731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:08.946157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:09.010782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:09.019552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49ab6a8a-423a-418e-a822-22255821e50a tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.087916 Sep 19 11:48:09.020122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1302/2635] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:08 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:10.042423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:10.043037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:10.049964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:10.050447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:10.050917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:10.051640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:10.052101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:10.052530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:10.113108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:10.121522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ac4a8f1f-b2fe-4d5a-bea3-b186afcc432f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.082999 Sep 19 11:48:10.122102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1334/2636] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:10 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:11.145796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:11.146615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:11.153144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:11.153635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:11.154073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:11.154764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:11.155249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:11.155678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:11.218855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:11.227687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e84894b-865a-4786-8254-08a04adce08f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085969 Sep 19 11:48:11.228340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1303/2637] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:11 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:12.251533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:12.252180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:12.258831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:12.259356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:12.259801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:12.260491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:12.260950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:12.261388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:12.322724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:12.331483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-49bd0085-7dd3-4601-8658-b4cfb5332ef4 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.083930 Sep 19 11:48:12.332060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1335/2638] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:12 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:13.357036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:13.357637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:13.364831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:13.365351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:13.365789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:13.366532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:13.366939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:13.367419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:13.430229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:13.438459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d26f762d-2114-429e-995a-dadfcdf9843f tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085318 Sep 19 11:48:13.439035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1304/2639] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:13 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:14.461579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:14.462157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: c3837b49-df54-4e20-a19e-5be03f339e84] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:48:14.464543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=28 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:48:14.469231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:14.480482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:14.480482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:14.480482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:48:14.480482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:48:14.481337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:48:14.535141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:48:14.543557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2700bd08-0e7a-4b40-ac39-1f2464433ff8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84" status: 200 len: 1376 microversion: 2.1 time: 0.085851 Sep 19 11:48:14.543974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1336/2640] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:48:14 2022] GET /compute/v2.1/servers/c3837b49-df54-4e20-a19e-5be03f339e84 => generated 1376 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:48:14.565726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-65442ba4-d6f7-47cf-81e4-ed219d85b4ac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '.version_select at 0x7f4b9ddb7ca0>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:48:14.649565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-65442ba4-d6f7-47cf-81e4-ed219d85b4ac tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174002775" status: 202 len: 0 microversion: 2.1 time: 0.087573 Sep 19 11:48:14.650146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1305/2641] 10.222.0.78 () {58 vars in 1221 bytes} [Mon Sep 19 11:48:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1174002775 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 11:50:15.413054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a61e391-cf5e-4b5b-8e83-9b022a7b5946] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 11:50:15.415935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:15.415935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=41 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:15.415935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:50:15.415935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:50:15.416528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:50:15.417364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:50:15.418287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:50:15.418469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:50:15.425276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:15.425772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:15.491817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c5ebcaf-5fcc-467e-864b-bd7760c36cbf] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 11:50:15.491817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=35 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:15.491817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:15.491817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:50:15.491817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c (ip 10.222.0.78) !!! Sep 19 11:50:15.491817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:50:15.491817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:50:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c (ip 10.222.0.78) !!! Sep 19 11:50:15.492817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:15.492817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:15.493014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.493014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.493014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.493014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.493438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.493438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.493613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.493613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.493613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.493613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.494061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.494061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.513667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:50:15.521849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:50:15.860548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-91a31fad-1da9-4999-8fe2-9332e9fc8f03 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 204 len: 0 microversion: 2.1 time: 0.449202 Sep 19 11:50:15.861140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1337/2642] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:50:15 2022] DELETE /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:50:15.866294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:15.866872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:15.872722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.873207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.873647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.874431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.874889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.875353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.883935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b0773006-8e38-4448-b352-86fc741ad959 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 204 len: 0 microversion: 2.20 time: 0.429650 Sep 19 11:50:15.885693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1306/2643] 10.222.0.78 () {60 vars in 1280 bytes} [Mon Sep 19 11:50:15 2022] DELETE /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 19 11:50:15.890604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:15.891222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:15.897056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.897542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.897982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.898723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.899163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.899619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.902687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 11:50:15.917655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 HTTP/1.1 Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:50:15.919904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:15.921789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '908c5502-74d2-42f5-bd69-d99ade535859'} Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:50:15.922951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:15.924492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:15.926573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:50:15.926573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cf3d44d7-5caf-45cc-a153-f1b2c9062f88 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 404 len: 111 microversion: 2.1 time: 0.034867 Sep 19 11:50:15.926573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1307/2644] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:50:15 2022] DELETE /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:50:15.926573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:15.927114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:15.933050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.933543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.933981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:15.934675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:15.935133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:15.935587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:16.160239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-61072998-404a-4a4c-8dc6-efb1da880787 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 204 len: 0 microversion: 2.1 time: 0.297653 Sep 19 11:50:16.161019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1338/2645] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:50:15 2022] DELETE /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 11:50:16.168621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:16.168621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:16.174278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:16.174770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:16.175235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:16.176062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:16.176517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:16.176945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:16.309785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:16.318171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-71caf3e2-e5f2-4050-8251-e4daea02c9f5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.395388 Sep 19 11:50:16.318741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1308/2646] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:15 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:16.323861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:16.324469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 908c5502-74d2-42f5-bd69-d99ade535859] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:16.330251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:16.330732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:16.331188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:16.331878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:16.332332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:16.332756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:16.343320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:16.346582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 HTTP/1.1 Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:50:16.348167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:16.349989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '908c5502-74d2-42f5-bd69-d99ade535859'} Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:50:16.350877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. Sep 19 11:50:16.352392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:50:16.355092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 908c5502-74d2-42f5-bd69-d99ade535859 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:50:16.355284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:16.355467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-91591586-678b-4a6b-a8b6-80b4381fb499 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859" status: 404 len: 111 microversion: 2.1 time: 0.029857 Sep 19 11:50:16.355467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1309/2647] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:16 2022] GET /compute/v2.1/servers/908c5502-74d2-42f5-bd69-d99ade535859 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:50:16.355799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:16.355799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cac41843-7cea-498a-a47f-29bd4eab8a80 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.189441 Sep 19 11:50:16.356133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:16.356133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:16.360558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1339/2648] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:16.362037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:16.362526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:16.362963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:16.363694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:16.364144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:16.364568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:16.464798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c5ebcaf-5fcc-467e-864b-bd7760c36cbf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 39462. Sep 19 11:50:16.492747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:16.501048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-439e12a5-ed60-4fb1-8628-f7a49735829f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.150037 Sep 19 11:50:16.501612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1310/2649] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:17.342467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:17.343081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:17.351126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:17.351634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:17.352076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:17.352765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:17.353227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:17.354150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:17.359632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a61e391-cf5e-4b5b-8e83-9b022a7b5946] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 39466. Sep 19 11:50:17.379656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:17.380184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:17.386236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:17.386728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:17.387194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:17.387889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:17.388373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:17.388779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:17.538064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:17.547707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf949520-2985-4c1e-9653-2e9a40dd07f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.208911 Sep 19 11:50:17.548351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1340/2650] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:17 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:17.552888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:17.553494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:17.559502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:17.569098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:17.569098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:17.569098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:17.569098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:17.569681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:17.569781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:17.576156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:17.577602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:17.578778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-58527d7b-145e-4596-825b-66bc9067ef6e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.203228 Sep 19 11:50:17.579368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1311/2651] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:17.690355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:17.698848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-490f5b55-4ae4-4377-b812-1229d5a3d390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149520 Sep 19 11:50:17.699526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1341/2652] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:18.570671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:18.571325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:18.578478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:18.578962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:18.579444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:18.580164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:18.580622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:18.581052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:18.605632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:18.606240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:18.612626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:18.613112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:18.613559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:18.614251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:18.614710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:18.615138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:19.016593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:19.020338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:19.025118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e00ceee7-e1bb-46f7-ad98-24f46bd59e1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.458256 Sep 19 11:50:19.026326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1312/2653] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:18 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:19.029652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:19.030993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:19.031190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:19.031715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:19.032275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-db96292f-0f4a-4b00-8794-f1b2047a0059 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.431107 Sep 19 11:50:19.037673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:19.038160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:19.038607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:19.039326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:19.039781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:19.040211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:19.045130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1342/2654] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:19.170009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:19.178219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f2e38a6e-3a18-430c-9094-7df200c653b2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.150723 Sep 19 11:50:19.178712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1313/2655] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:20.049084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:20.049677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:20.056189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:20.056676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:20.057115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:20.057831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:20.058289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:20.058462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:20.058896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:20.059070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:20.065118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:20.065595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:20.066022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:20.066699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:20.067144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:20.067586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:20.249889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:20.253069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:20.271942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-84945511-3709-47df-bf12-c82c9f56ce9f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.213089 Sep 19 11:50:20.271942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1343/2656] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:20 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:20.272214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:20.272321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:20.272411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:20.272527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:20.272623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-702c6240-de49-4103-abcd-10cbf4a6ecb3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.210813 Sep 19 11:50:20.272623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1314/2657] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:20.272780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:20.272780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:20.272780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:20.272780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:20.273146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:20.273146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:20.402756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:20.410920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1b576c26-ac97-4ff0-850c-98e2734e04d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151003 Sep 19 11:50:20.411512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1344/2658] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:21.287382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:21.287994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:21.293121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:21.294001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:21.294856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:21.295388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:21.295834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:21.296530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:21.296990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:21.297418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:21.300727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:21.301224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:21.301670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:21.302373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:21.302829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:21.303365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:21.488824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:21.492620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:21.499300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7f72c415-04a3-49be-a75d-1a47f9c410e6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215805 Sep 19 11:50:21.499981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1315/2659] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:21 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:21.501925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:21.503461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:21.504681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-01092ad2-b843-49b0-9eea-dc255aad6c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215470 Sep 19 11:50:21.505650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1345/2660] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:21.509289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:21.511051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:21.520411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:21.520904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:21.521342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:21.522154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:21.522513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:21.523104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:21.651865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:21.660464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42ae6ca2-ae5c-4d83-9229-a27ae4dd6605 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.159168 Sep 19 11:50:21.660883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1316/2661] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:22.524924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:22.526117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:22.532597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:22.533192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:22.533624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:22.534319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:22.534773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:22.535262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:22.539200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:22.539200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:22.545214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:22.545696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:22.546131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:22.546829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:22.547317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:22.547746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:22.734481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:22.738019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:22.743433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a3632bd8-6c98-45eb-ae32-c1a09eb5a61f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.222308 Sep 19 11:50:22.744533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1346/2662] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:22 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:22.749553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:22.750162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:22.750995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:22.752571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:22.754034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8152b1d7-49f1-4888-b752-48ebc283be60 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219732 Sep 19 11:50:22.754660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1317/2663] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:22.756317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:22.756876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:22.757521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:22.758220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:22.758682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:22.759108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:22.890150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:22.898404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cea64832-3381-404d-80cf-962c107b0b19 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152494 Sep 19 11:50:22.898912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1347/2664] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:23.766363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:23.766977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:23.773473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:23.773962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:23.774398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:23.775699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:23.776365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:23.776795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:23.780926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:23.784566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:23.788094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:23.788572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:23.789054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:23.789740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:23.790200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:23.790609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:23.978647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:23.981905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:23.986956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7e6d91b-fcec-4fce-a604-962a1941c235 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.224467 Sep 19 11:50:23.987631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1318/2665] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:23 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:23.990798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:23.992349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:23.992521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:23.993012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:23.993701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9592ecfb-f2dc-4aeb-9cca-cbbc63e6da1b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216578 Sep 19 11:50:23.994460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1348/2666] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:23.999844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:24.000335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:24.000890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:24.001615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:24.002071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:24.002496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:24.136191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:24.144526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0410f661-c4d3-428a-9ef0-c42b4ade9f71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.155926 Sep 19 11:50:24.145100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1319/2667] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:25.010982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:25.011596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:25.018111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:25.018604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:25.019045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:25.019497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:25.019936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:25.020121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:25.020253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:25.020615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:25.026463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:25.026943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:25.027405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:25.028091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:25.028545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:25.028960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:25.216130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:25.219205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:25.224506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-45be455a-7b47-4327-be7e-1a7a7e4bc0f3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.218046 Sep 19 11:50:25.225076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1349/2668] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:25 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:25.228318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:25.229763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:25.230662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:25.230928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bd1e0f2a-97af-4107-b8fd-351f5b04cb2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215265 Sep 19 11:50:25.231315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:25.231806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1320/2669] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:25.237186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:25.237675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:25.238111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:25.238805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:25.239294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:25.239736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:25.244968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:25.375566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:25.383963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2c87c390-8371-4a36-bad6-ae3cc092dc66 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.157156 Sep 19 11:50:25.384536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1350/2670] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:26.256145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:26.256703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:26.257102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:26.257278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:26.263825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:26.264272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:26.264395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:26.264722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:26.264841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:26.265184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:26.265406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:26.265857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:26.265981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:26.266272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:26.266380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:26.266734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:26.460706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:26.467792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:26.469042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a19b503c-2c5e-45cf-a351-472356ca3aba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216697 Sep 19 11:50:26.469654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1321/2671] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:26 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:26.475053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:26.475968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:26.476522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:26.477964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:26.479146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d07604ad-97bf-44eb-b455-3ba0911e99bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.226474 Sep 19 11:50:26.479868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1351/2672] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:26.482446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:26.483041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:26.483672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:26.484379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:26.484840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:26.485271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:26.489395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:26.613137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:26.622291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d51e8f92-0d56-4338-9b78-4aae07c2c02d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.150814 Sep 19 11:50:26.622875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1322/2673] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:27.491659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:27.492255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:27.498549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:27.499034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:27.499517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:27.500204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:27.500658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:27.501085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:27.506036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:27.506656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:27.513315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:27.513805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:27.514248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:27.514945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:27.515429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:27.515857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:27.690395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:27.701212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-86ab8015-5a22-494d-91a9-7d600dfee2a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.213583 Sep 19 11:50:27.701831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1352/2674] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:27 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:27.706640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:27.707306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:27.714543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:27.715028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:27.715490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:27.715717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:27.716180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:27.716659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:27.717082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:27.724653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:27.726385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:27.727594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d6a2667a-86ae-4e71-a2ae-3498de5e3b2d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.225517 Sep 19 11:50:27.728152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1323/2675] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:27.847039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:27.855656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3c90a1a1-78ae-4e4c-b1ff-0208389eb2dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152867 Sep 19 11:50:27.856222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1353/2676] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:28.725680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:28.726320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:28.732702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:28.733184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:28.733615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:28.734289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:28.734734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:28.735157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:28.754021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:28.754664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:28.762003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:28.762487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:28.762927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:28.763642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:28.764096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:28.764526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:28.936099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:28.939235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:28.944595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-431fda69-cea6-47aa-837b-1bb4503aa321 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.222681 Sep 19 11:50:28.951224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1324/2677] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:28 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:28.951409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:28.951409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:28.951616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:28.951616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:28.951814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a1fcadae-4eca-4a1d-9c2f-1c3d4a40ffa1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.201611 Sep 19 11:50:28.952239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1354/2678] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:28.956862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:28.957422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:28.957947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:28.958715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:28.959276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:28.959788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:29.089185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:29.097240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f871149d-2b8c-460a-8b58-8c29ab929e92 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.150992 Sep 19 11:50:29.097802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1325/2679] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:29.969292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:29.969851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:29.976485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:29.976970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:29.977406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:29.978090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:29.978540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:29.978959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:29.980307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:29.980925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:29.987397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:29.988042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:29.988483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:29.989175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:29.989644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:29.990069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:30.176805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:30.181012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:30.185704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5b7e5832-2887-4562-9efc-71d99ef8d18c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.220338 Sep 19 11:50:30.186293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1355/2680] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:29 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:30.190307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:30.190709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:30.191345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:30.191799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:30.192964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e964739-24f2-4d15-883d-457f25d123c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216708 Sep 19 11:50:30.194047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1326/2681] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:30.197262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:30.198329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:30.198773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:30.199494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:30.199949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:30.200377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:30.327239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:30.335492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-23c38aea-34c0-463b-8c65-6806d4ed2db7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.148229 Sep 19 11:50:30.336059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1356/2682] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:31.220691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:31.221175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:31.221528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:31.221639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:31.228450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:31.228657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:31.230645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:31.230767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:31.230901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:31.230996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:31.231102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:31.231220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:31.231312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:31.231398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:31.231500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:31.231590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:31.429557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:31.433725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:31.438184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6afcda2b-1a6f-4298-952b-ec1e970870a3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221506 Sep 19 11:50:31.438756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1327/2683] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:31 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:31.442808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:31.443240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:31.444038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:31.444544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:31.445792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c789144a-8a03-4459-851f-150437ed2bcf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.228858 Sep 19 11:50:31.446548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1357/2684] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:31.450664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:31.451151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:31.451614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:31.452306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:31.452760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:31.453184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:31.587906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:31.597374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b2d509d9-9534-48cf-a033-a92dca25e513 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.157634 Sep 19 11:50:31.597949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1328/2685] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:32.467051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:32.467619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:32.471961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:32.472647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:32.474303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:32.474816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:32.475269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:32.475968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:32.476440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:32.476879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:32.479720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:32.480214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:32.480650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:32.481349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:32.481803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:32.482736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:32.670881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:32.677513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:32.679217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-04bcb725-6f93-4c13-aae2-27cd87d62b1f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216538 Sep 19 11:50:32.686524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1358/2686] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:32 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:32.686524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:32.686524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:32.687018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:32.688123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:32.689764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49518e80-51e1-421a-a174-24c7984ab19e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.222005 Sep 19 11:50:32.690505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1329/2687] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:32.690820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:32.691336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:32.691771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:32.692449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:32.692894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:32.693310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:32.824131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:32.832575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8538a385-d2f7-4829-80fb-6f894eccd53e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151655 Sep 19 11:50:32.833141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1359/2688] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:33.702443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:33.703058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:33.709646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:33.710135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:33.710574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:33.711309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:33.711770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:33.712198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:33.715024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:33.716159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:33.722464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:33.728147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:33.728147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:33.728147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:33.728147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:33.728572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:33.906569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:33.914845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a8ec3d6-3d09-40e8-8565-09bbcfe49807 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216241 Sep 19 11:50:33.915386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1330/2689] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:33 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:33.918640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:33.920720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:33.921331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:33.927126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:33.927640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:33.928069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:33.928208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:33.928751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:33.929226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:33.929627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:33.929767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:33.930796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b254cc69-745a-4743-87d5-ab0a3f868e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220152 Sep 19 11:50:33.931488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1360/2690] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:34.066021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:34.074460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a4d8987d-1190-4f4c-9a0f-0224ba18165b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.158124 Sep 19 11:50:34.075030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1331/2691] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:34.938426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:34.939022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:34.945451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:34.945928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:34.946361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:34.947043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:34.947524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:34.948615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:34.957209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:34.957837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:34.964288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:34.964775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:34.965218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:34.965908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:34.966373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:34.966834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:35.145425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:35.149504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:35.153915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-42af5ad3-d525-477e-b2e3-dafb54b258b5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.219330 Sep 19 11:50:35.154498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1361/2692] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:34 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:35.158209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:35.158909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:35.159543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:35.159745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:35.160997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a6503db5-96f4-438b-9d84-b7aa0651da0d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.207524 Sep 19 11:50:35.161569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1332/2693] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:35.165320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:35.165804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:35.166244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:35.167482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:35.167941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:35.168642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:35.299744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:35.307991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85a10813-0a2e-430c-9815-6c90bf38ebaa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152547 Sep 19 11:50:35.308555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1362/2694] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:36.178197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:36.178790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:36.185799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:36.186280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:36.186708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:36.187416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:36.187533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:36.187949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:36.188197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:36.188304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:36.194581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:36.195053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:36.195542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:36.196233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:36.196686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:36.197110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:36.384306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:36.389574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:36.393458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e7bedc4f-90cb-4183-acd7-a2ce43a3add5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.219115 Sep 19 11:50:36.394042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1333/2695] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:36 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:36.398434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:36.398628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:36.399145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:36.399894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:36.401048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1dc0edc-d64c-4d75-987d-b90c68fe9266 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.217541 Sep 19 11:50:36.401590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1363/2696] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:36.405347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:36.405837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:36.406273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:36.406961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:36.407621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:36.408047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:36.543099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:36.548344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e99b7c21-1ddc-4e5c-9f8a-788f176dc0f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.153352 Sep 19 11:50:36.548912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1334/2697] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:37.418380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:37.418920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:37.425481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:37.425963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:37.426391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:37.427068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:37.427544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:37.427964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:37.428141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:37.428637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:37.435121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:37.435645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:37.436082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:37.436780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:37.437240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:37.437667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:37.617205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:37.625507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-767b7112-4952-4fd6-b674-def59edfdd55 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.211413 Sep 19 11:50:37.639198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1364/2698] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:37 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:37.639442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:37.639587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:37.639587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:37.639587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:37.639587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:37.639996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:37.640116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:37.640116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:37.640116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:37.640402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:37.640510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:37.641025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b719a3f2-ed9c-49ea-b797-1c80f959747c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216825 Sep 19 11:50:37.641584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1335/2699] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:37.770034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:37.778813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-029c2b01-f2b7-4fb5-b138-e4760def2e1f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151442 Sep 19 11:50:37.784195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1365/2700] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:38.651521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:38.652126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:38.658603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:38.659087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:38.659558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:38.660250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:38.660703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:38.661135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:38.677087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:38.677716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:38.685108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:38.685612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:38.686061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:38.686795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:38.687289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:38.687724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:38.844676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:38.853078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-206c837c-657c-4bfc-8f20-767c0c966f6c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.205466 Sep 19 11:50:38.854168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1336/2701] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:38 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:38.858704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:38.859341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:38.865203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:38.865693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:38.866135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:38.866827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:38.867315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:38.867462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:38.867745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:38.871520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:38.877410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:38.878784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:38.879986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-39c9978c-7bc7-43e1-b73c-50992b21bbca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.209317 Sep 19 11:50:38.884163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1366/2702] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:38.996658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:39.004885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7c66fa5e-0ff6-41a4-b87e-e74522e380a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149753 Sep 19 11:50:39.005462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1337/2703] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:39.878224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:39.878840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:39.885269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:39.885757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:39.886198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:39.886887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:39.887381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:39.887815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:39.907782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:39.908386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:39.914712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:39.915202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:39.915645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:39.916824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:39.917320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:39.917689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:40.068022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:40.076207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5ace63ce-dfc1-4bd5-b594-563d711d7567 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.202211 Sep 19 11:50:40.076803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1367/2704] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:39 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:40.081273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:40.081876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:40.087610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:40.088616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:40.089052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:40.089737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:40.090189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:40.090613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:40.097273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:40.100828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:40.110388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:40.110388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:40.110388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d08c1efa-0ef7-44fc-939e-34f53af9de04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.206468 Sep 19 11:50:40.113275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1338/2705] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:40.220188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:40.229403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fbf1a3cd-ae54-48a8-9843-da052b9bec6f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151025 Sep 19 11:50:40.229971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1368/2706] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:41.099871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:41.100482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:41.108142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:41.108616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:41.109058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:41.109752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:41.110211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:41.110643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:41.137404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:41.138010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:41.144517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:41.145002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:41.145442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:41.146137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:41.146595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:41.147022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:41.292938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:41.301574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e3a5b07-2f4c-4168-aa18-5e0cfdefc5c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.205518 Sep 19 11:50:41.302164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1339/2707] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:41 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:41.306616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:41.307829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:41.313606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:41.314131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:41.320731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:41.320731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:41.320731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:41.320731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:41.321305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:41.329949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:41.331407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:41.332558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f7f07316-0c76-482d-b792-c7cacaba8692 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.199131 Sep 19 11:50:41.333118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1369/2708] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:41.449335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:41.457612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-33dbd1e5-9cb4-48e9-a55c-77e40d010593 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.154477 Sep 19 11:50:41.458180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1340/2709] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:42.325599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:42.326199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:42.332695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:42.333180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:42.333620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:42.334310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:42.334782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:42.335218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:42.358689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:42.359482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:42.365793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:42.366273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:42.366700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:42.367482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:42.367861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:42.368283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:42.520451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:42.529172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-66d16a8c-3db0-42ed-8771-34a20523afaa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.207494 Sep 19 11:50:42.529754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1370/2710] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:42 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:42.534323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:42.534931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:42.541759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:42.542265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:42.542700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:42.543696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:42.544150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:42.544576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:42.794299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:42.802972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:42.804435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:42.805599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e643f4c0-d4a9-4628-9075-570522ae14a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.451448 Sep 19 11:50:42.806151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1341/2711] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:42.878669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:42.887467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-655478de-6e77-44a9-9e48-ee003f7a377c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.356738 Sep 19 11:50:42.888040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1371/2712] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:43.555679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:43.556286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:43.563438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:43.563918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:43.564384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:43.565072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:43.565524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:43.565948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:43.697728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:43.706074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6cbfa5a4-0090-4949-9387-b66dbf985d39 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154281 Sep 19 11:50:43.706641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1342/2713] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:43 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:43.831239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:43.831816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:43.838750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:43.839257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:43.839743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:43.840434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:43.840895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:43.841326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:43.911831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:43.912598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:43.919745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:43.920322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:43.920772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:43.921485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:43.921953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:43.922388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:44.008919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:44.018242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:44.019572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:44.020794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-27e9afb2-277c-40e4-a791-592fddf1f73b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.193590 Sep 19 11:50:44.021366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1372/2714] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:44.069216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:44.077936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-494d0430-c96c-4055-a6be-284fd93c00b6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.170140 Sep 19 11:50:44.078503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1343/2715] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:44.729756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:44.730365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:44.736360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:44.736837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:44.737359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:44.738048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:44.738498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:44.738922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:44.868613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:44.877454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-33b5ae7b-161f-49ef-823f-6e99abbaa791 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151941 Sep 19 11:50:44.878030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1373/2716] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:44 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:45.047649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:45.048332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:45.054881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:45.055405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:45.055847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:45.056538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:45.057598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:45.058030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:45.101849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:45.102461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:45.110474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:45.110474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:45.110474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:45.110885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:45.111084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:45.111540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:45.225192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:45.234550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:45.236007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:45.237171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-31d1d2a1-f6de-4ae9-a6db-d49f660c82aa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.193506 Sep 19 11:50:45.237729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1344/2717] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:45.271658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:45.280272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c2a38584-74a0-49ab-ab65-996fa65041ae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.182359 Sep 19 11:50:45.280830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1374/2718] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:45.901497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:45.902109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:45.903985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:45.908986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:45.915550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:45.915550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:45.915550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:45.915550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:45.915977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:46.042105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:46.050541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1ae67a68-5db7-4f39-8705-e2743306dbdd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153575 Sep 19 11:50:46.051150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1345/2719] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:45 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:46.263336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:46.264026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:46.266491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:46.271585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:46.272078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:46.272515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:46.273215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:46.273720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:46.274145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:46.304498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:46.305112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:46.312800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:46.313287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:46.313719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:46.314412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:46.314860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:46.315308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:46.462017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:46.470667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:46.472141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:46.473306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-68b5e221-9fb2-4667-b528-25af513a376c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215090 Sep 19 11:50:46.473865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1375/2720] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:46.488394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:46.497259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-930feb5b-0f3c-47dc-bc8c-d92cbd3db714 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.196542 Sep 19 11:50:46.497830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1346/2721] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:47.074850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:47.075512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:47.081724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:47.082211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:47.082642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:47.083450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:47.083910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:47.084335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:47.212237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:47.221074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3bf49b88-9372-4ce7-8b84-527304cdb6a6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150633 Sep 19 11:50:47.221648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1376/2722] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:47 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:47.500163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:47.500807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:47.507390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:47.507882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:47.508325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:47.509049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:47.509546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:47.510730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:47.520587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:47.524808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:47.527478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:47.527970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:47.528410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:47.529112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:47.529571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:47.530296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:47.703962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:47.712077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:47.713536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:47.714713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-88a93b7a-97d6-4e07-9e60-d0c3cb6f1949 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.218598 Sep 19 11:50:47.715297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1347/2723] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:47.720150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:47.728403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce5cd50f-89d8-42bd-bdfa-597674c18fcc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.211936 Sep 19 11:50:47.728968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1377/2724] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:48.244120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:48.244719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:48.250661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:48.251138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:48.251603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:48.252280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:48.252728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:48.253149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:48.386950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:48.395667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2456e269-857d-42ec-837d-e8df17bd4598 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155301 Sep 19 11:50:48.396248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1348/2725] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:48 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:48.740425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:48.740979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:48.747394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:48.747875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:48.748304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:48.748992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:48.749463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:48.749852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:48.753100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:48.753712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:48.759994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:48.760988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:48.761421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:48.762110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:48.762562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:48.762987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:48.948233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:48.952979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:48.957900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:48.959445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:48.960631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fab63008-1a21-434d-8432-1c67ce284f6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.224269 Sep 19 11:50:48.961251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1378/2726] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:48.961536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2d5101f7-f319-4e38-a675-752593d94d25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.212300 Sep 19 11:50:48.962317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1349/2727] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:49.420702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:49.421227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:49.427223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:49.427757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:49.428155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:49.428845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:49.429299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:49.429732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:49.556895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:49.565597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8f0d86b2-3283-4288-8d08-0ec3bfcf6680 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149661 Sep 19 11:50:49.566183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1379/2728] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:49 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:49.985269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:49.985828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:49.986826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:49.987460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:49.992074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:49.992560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:49.992998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:49.993704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:49.993868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:49.994283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:49.994409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:49.994720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:49.994860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:49.995448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:49.995894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:49.996314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:50.221933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:50.229207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:50.232480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-00a1cfa0-8f46-4ebe-815f-f1f772076376 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.251115 Sep 19 11:50:50.233231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1350/2729] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:50.238547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:50.239942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:50.246779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a69c21a8-9efa-46eb-a342-2cebf29bdc0e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.258287 Sep 19 11:50:50.246779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1380/2730] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:50.589370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:50.589994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:50.596067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:50.596621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:50.597090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:50.597790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:50.598262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:50.599009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:50.738913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:50.747707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bcb93099-dc5b-44ab-99a6-d2c08208bcdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.162746 Sep 19 11:50:50.748294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1351/2731] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:50 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:51.258434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:51.259034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:51.266323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:51.266750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:51.267197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:51.267897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:51.268349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:51.268769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:51.271557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:51.272180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:51.278409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:51.278899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:51.279383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:51.280158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:51.280586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:51.280976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:51.471675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:51.474597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:51.480335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ed352b66-1698-49cf-b88a-261e3cc89a30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.225692 Sep 19 11:50:51.481000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1381/2732] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:51.483514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:51.484954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:51.486121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cc2766a3-3957-4d25-a613-ef8c4ad4873d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.218425 Sep 19 11:50:51.486664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1352/2733] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:51.770950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:51.771612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:51.777928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:51.778415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:51.778853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:51.779592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:51.780048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:51.780478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:51.914576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:51.923809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d98004a6-bd61-4532-bd88-f56f32073bd9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156862 Sep 19 11:50:51.924386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1382/2734] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:51 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:52.504649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:52.505264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:52.512288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:52.512456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:52.512891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:52.513025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:52.513185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:52.513897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:52.514330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:52.514759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:52.519119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:52.519636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:52.520079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:52.520774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:52.521231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:52.521659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:52.540300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:52.705029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:52.711883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:52.713336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a88adf35-c25e-4123-8a01-f7b720d788c1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.212482 Sep 19 11:50:52.713905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1353/2735] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:52.720940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:52.722402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:52.723608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0bc0f9c4-f1cb-40b5-a481-68d89c7fe08c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215555 Sep 19 11:50:52.724164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1383/2736] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:52.947153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:52.948341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:52.954410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:52.954898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:52.955376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:52.956073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:52.956546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:52.956950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:53.087049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:53.095337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2100b9b8-7118-4bf6-b0b4-5b4d618d1b25 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152281 Sep 19 11:50:53.095916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1354/2737] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:52 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:53.736434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:53.737047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:53.743558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:53.744045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:53.744575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:53.745280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:53.745732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:53.746161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:53.749631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:53.750303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:53.756437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:53.759864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:53.759864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:53.759864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:53.759864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:53.760487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:53.777989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:50:53.948599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:53.953006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:53.956943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ac274af5-4736-49e5-a146-2ce66c939e17 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.224382 Sep 19 11:50:53.957520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1384/2738] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:53.961746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:53.963253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:53.964958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9d7fc706-4147-4a6b-8d38-eb86007bad37 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219322 Sep 19 11:50:53.965521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1355/2739] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:54.119763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:54.120370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:54.126443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:54.126916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:54.127391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:54.128049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:54.128493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:54.128943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:54.259014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:54.267970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0890a11c-279c-49ff-af92-ecc1e2e9b6ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152070 Sep 19 11:50:54.268530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1385/2740] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:54 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:54.981857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:54.982453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:54.988959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:54.989445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:54.989685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:54.990085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:54.990297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:54.990555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:54.991016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:54.991476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:54.997386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:54.997868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:54.998305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:54.998998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:54.999488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:54.999923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:55.185114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:55.188896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:55.193556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-01304eef-2178-4f88-add8-fc8a484424c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.215555 Sep 19 11:50:55.194147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1356/2741] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:55.198889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:55.200364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:55.201515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-df90094b-f9f0-4684-9ecc-40da1979c3af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215665 Sep 19 11:50:55.202061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1386/2742] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:55.291024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:55.291666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:55.298321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:55.298807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:55.299272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:55.299972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:55.300424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:55.300854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:55.435360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:55.443671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d930e636-cbeb-4a11-97d5-d28f5c0d3d63 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156629 Sep 19 11:50:55.444237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1357/2743] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:55 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:50:56.217957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:56.218572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:56.225255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:56.225746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:56.226199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:56.226899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:56.227385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:56.227818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:56.227932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:56.228423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:56.235506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:56.236004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:56.236450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:56.238412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:56.238886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:56.239372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:56.428861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:56.435943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:56.437920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4678042-0b00-4107-a26a-1ae79eafd880 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.224372 Sep 19 11:50:56.438588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1387/2744] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:56.444733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:56.446236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:56.447477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aac5dde7-a967-400a-997f-00b088c773c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.223468 Sep 19 11:50:56.447971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1358/2745] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:56.465890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:56.466501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:56.472423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:56.472907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:56.473347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:56.474042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:56.474496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:56.474931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:56.604871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:56.613182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-62d7ecec-04c7-426f-9e73-caf94feb4855 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151334 Sep 19 11:50:56.613755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1388/2746] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:56 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:57.461956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:57.462540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:57.469684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:57.470171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:57.470617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:57.471359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:57.471821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:57.472249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:57.473304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:57.474043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:57.481077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:57.481597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:57.482011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:57.482709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:57.483192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:57.483659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:57.675837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:57.679736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:57.684492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1f58a520-5785-410a-98f7-4c1b9c314ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.226498 Sep 19 11:50:57.685077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1359/2747] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:57.689577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:57.690185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:57.695972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:57.696463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:57.696907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:57.697605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:57.698061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:57.698490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:57.699609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:57.701173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:57.703749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-01dd1dfd-acd4-413b-a855-fd2a416bd3ea tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.234275 Sep 19 11:50:57.708048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1389/2748] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:50:57.835855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:57.844878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-89a1aa4e-7f04-4cba-be22-eb15d25cb54f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.158787 Sep 19 11:50:57.845458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1360/2749] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:57 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:58.708475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:58.709121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:58.716307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:58.716794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:58.717244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:58.717930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:58.718379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:58.718810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:58.732529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:58.733141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:58.739477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:58.739961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:58.740397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:58.741085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:58.741538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:58.741958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:58.904798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:58.918723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2a6a58c0-00e4-45a0-8fe4-d08dae3db534 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.208585 Sep 19 11:50:58.918723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1390/2750] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:58.919613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:58.919797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:58.920312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:58.926546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:58.927121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:58.927656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:58.928424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:58.928955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:58.929078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:58.929492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:58.930456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:58.931653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1b90d370-edf0-4dfc-a6af-e56c37a9ef9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.203648 Sep 19 11:50:58.932211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1361/2751] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:50:59.061561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:50:59.069700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5f1f5fbf-9f7f-43c9-b89d-c44fffb809ff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155040 Sep 19 11:50:59.070258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1391/2752] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:58 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:50:59.937861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:59.938421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:59.944796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:59.945270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:59.945700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:59.946418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:59.946866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:59.947324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:59.957905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:50:59.958513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:50:59.965537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:59.966024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:59.966472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:50:59.967188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:50:59.967648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:50:59.968076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:00.145710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:00.152789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:00.154603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e6c79e67-c6eb-4c50-a4fe-e3238dd85780 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.220698 Sep 19 11:51:00.155201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1362/2753] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:50:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:00.159734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:00.160340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:00.161822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:00.163256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:00.164426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ca9f6a1d-9dbc-4688-835f-204ba325ffc2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.210466 Sep 19 11:51:00.165149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1392/2754] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:50:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:00.166126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:00.166610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:00.167038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:00.168015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:00.168466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:00.168886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:00.296084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:00.304337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd590f13-c416-4004-9cc9-4f40cfb7bfa8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148160 Sep 19 11:51:00.304915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1363/2755] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:00 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:01.177937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:01.178611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:01.186560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:01.187049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:01.187566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:01.188271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:01.188731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:01.189161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:01.190407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:01.191051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:01.197140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:01.197638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:01.198080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:01.198778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:01.199502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:01.199937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:01.389659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:01.395225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:01.398750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7cd23733-9005-4c93-bb22-fdeeffd572c4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.224624 Sep 19 11:51:01.399468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1393/2756] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:01.404599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:01.405487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:01.405644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:01.407063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:01.408480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cdb5fa82-4ae8-4ec7-9826-7938d3921acc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.222264 Sep 19 11:51:01.409115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1364/2757] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:01.419111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:01.419699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:01.420133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:01.420824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:01.421292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:01.421707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:01.551384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:01.560320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5bd357e3-3110-4a72-821b-29d66913abf9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159806 Sep 19 11:51:01.569909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1394/2758] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:01 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:02.429297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:02.429851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:02.434126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:02.434774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:02.437000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:02.437490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:02.437928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:02.438617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:02.439072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:02.439525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:02.440882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:02.441368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:02.441811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:02.442506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:02.442963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:02.443417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:02.635924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:02.643319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:02.644941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-454f1b96-d9f9-4bb1-988b-2c5d7c62570f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.219531 Sep 19 11:51:02.645522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1365/2759] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:02.649876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:02.650479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:02.652477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:02.653902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:02.655320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-00355b97-7986-40e1-a3c6-35c71a205e8d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.225339 Sep 19 11:51:02.656636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:02.656772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1395/2760] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:02.656867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:02.657353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:02.658047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:02.658498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:02.658917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:02.788601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:02.797630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e528c554-18fb-49c5-ba98-63b6837f6c2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151171 Sep 19 11:51:02.798199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1366/2761] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:02 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:03.667998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:03.668609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:03.675148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:03.675676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:03.676109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:03.676805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:03.677382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:03.677675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:03.682495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:03.683563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:03.689593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:03.696133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:03.696133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:03.696133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:03.696133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:03.696539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:03.879396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:03.882704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:03.888612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-33737f2f-133d-4ab0-b962-016eaa49c82b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.224680 Sep 19 11:51:03.889463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1396/2762] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:03.892100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:03.894014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:03.894553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:03.895267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:03.895607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7db878a5-cbe7-4c82-a66e-b24ff7d3ab0b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.217618 Sep 19 11:51:03.896480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1367/2763] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:03.902526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:03.903099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:03.903813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:03.904539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:03.905005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:03.905434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:04.040726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:04.049343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4c00e4f-1d9e-48b3-959d-d289b1b13cdb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159062 Sep 19 11:51:04.049911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1397/2764] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:03 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:04.912227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:04.912850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:04.920400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:04.920889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:04.921383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:04.921825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:04.922256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:04.922437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:04.922648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:04.922941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:04.929024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:04.929508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:04.929950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:04.930646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:04.931102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:04.931579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:05.113466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:05.120763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:05.122806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:05.124329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:05.125502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1ddfc19-7661-471a-8086-3cf53c2536ca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.208333 Sep 19 11:51:05.126076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1398/2765] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:05.130059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5128c03b-c5d9-4239-9d9d-9e67b96f53db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.221726 Sep 19 11:51:05.130437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:05.131213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1368/2766] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:05.131382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:05.136953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:05.137439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:05.137874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:05.138554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:05.139000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:05.139453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:05.266038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:05.274164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8db9cf35-f3e9-482e-a3a4-654aefb286cb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.147155 Sep 19 11:51:05.274719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1399/2767] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:05 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:06.151396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:06.152495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:06.153212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:06.153830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:06.158723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:06.159228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:06.159673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:06.160354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:06.160529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:06.160803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:06.160921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:06.161225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:06.161338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:06.161938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:06.162393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:06.162875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:06.167003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:06.354500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:06.359559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:06.364018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:06.365473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:06.366642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b1be3269-9774-4aac-be29-3a5849d4b4e6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219270 Sep 19 11:51:06.367221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1369/2768] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:06.368174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d0272303-c7e9-4e7a-ac8b-24bb13c8d8ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.219416 Sep 19 11:51:06.368903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1400/2769] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:06.371702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:06.372307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:06.378232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:06.378851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:06.379325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:06.380005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:06.380462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:06.380878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:06.513140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:06.521423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-193626a6-2d3b-48a1-8d16-7d0aa5e01462 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153184 Sep 19 11:51:06.521938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1370/2770] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:06 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:07.392337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:07.392904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:07.393298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:07.393430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:07.399279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:07.399766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:07.399902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:07.400206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:07.400351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:07.400717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:07.400899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:07.401355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:07.401478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:07.401783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:07.401881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:07.402823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:07.595439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:07.599641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:07.603968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b4db292e-410c-414b-8e42-27b502dd76db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.215605 Sep 19 11:51:07.604627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1401/2771] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:07.609142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:07.610013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:07.611339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:07.612874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:07.614318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d5001d59-bfa2-41d7-a79c-863d580e44dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.225369 Sep 19 11:51:07.621360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1371/2772] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:07.621548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:07.621548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:07.621548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:07.621548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:07.621933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:07.621933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:07.748324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:07.756592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2d4e7e30-3503-4e53-b93a-bc63e21a8690 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151008 Sep 19 11:51:07.760097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1402/2773] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:07 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:08.628138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:08.628765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:08.635269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:08.635767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:08.636209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:08.637520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:08.638062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:08.638498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:08.641718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:08.642335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:08.642700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:08.648818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:08.649307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:08.649744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:08.650437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:08.650895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:08.651366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:08.838750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:08.843077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:08.847117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-83d08056-f47b-402a-b556-794fb0263dd6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.222847 Sep 19 11:51:08.847740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1372/2774] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:08.852158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:08.852362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:08.852838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:08.853604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:08.854785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a1af3a31-2f97-4f8e-a623-c7a6862215ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.217233 Sep 19 11:51:08.859404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:08.859990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:08.860336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:08.861278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:08.861925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:08.862438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:08.866460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1403/2775] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:08.988256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:08.997101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e459f8cd-7ea7-46a9-b1ce-68809ed1f915 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148408 Sep 19 11:51:08.997671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1373/2776] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:08 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:09.871217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:09.871821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:09.878253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:09.878744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:09.879195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:09.879874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:09.880317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:09.880735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:09.881891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:09.882508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:09.889595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:09.890060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:09.890501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:09.891215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:09.891681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:09.892109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:10.077903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:10.082137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:10.086212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b40678d7-7a38-4102-aab2-954ef47e473b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.219260 Sep 19 11:51:10.086789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1404/2777] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:10.091077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:10.091338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:10.091842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:10.092596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:10.093769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b6b55112-123d-4956-b132-de5dcd0d85ba tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215780 Sep 19 11:51:10.094501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1374/2778] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:10.097984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:10.098761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:10.099219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:10.099913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:10.100368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:10.100792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:10.232540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:10.240850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-be50f9a6-7400-4778-9350-a75c06b66c1a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153039 Sep 19 11:51:10.241357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1405/2779] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:10 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:11.110306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:11.110960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:11.118035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:11.118520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:11.118959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:11.119602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:11.120035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:11.120160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:11.120264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:11.120592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:11.127337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:11.127816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:11.128245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:11.128923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:11.129374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:11.129792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:11.312107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:11.319012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:11.320488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-56cf404d-f997-495d-a054-4af70e9e2cbd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.214014 Sep 19 11:51:11.321076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1375/2780] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:11.326075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:11.329461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:11.329609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:11.330854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:11.332070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-78e4d150-dd71-4689-af82-e7d16cce8564 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216506 Sep 19 11:51:11.332801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1406/2781] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:11.332952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:11.333413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:11.333853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:11.334546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:11.335003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:11.335485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:11.471657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:11.480007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c6504fce-f1a0-4d85-8af8-90c45f6c2464 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157980 Sep 19 11:51:11.480581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1376/2782] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:11 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:12.345893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:12.346634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:12.353268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:12.353761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:12.354195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:12.354924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:12.355961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:12.356389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:12.358280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:12.359028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:12.365383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:12.365892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:12.366329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:12.367047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:12.367561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:12.367995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:12.563842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:12.572595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:12.574536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:12.575745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-92b48573-0652-4c9d-ad26-821e91c5d0c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.222025 Sep 19 11:51:12.576316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1377/2783] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:12.580738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:12.581348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:12.587437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:12.591100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:12.591628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:12.592104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:12.592811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:12.593415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:12.593847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:12.596551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-856e8f08-bc01-4035-bee4-28622a1aec1b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.254552 Sep 19 11:51:12.597092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1407/2784] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:12.721919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:12.730494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c7b3f94a-5f43-431c-9c2e-8435029fa66c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153229 Sep 19 11:51:12.731056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1378/2785] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:12 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:13.602199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:13.602836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:13.609226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:13.609714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:13.610153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:13.610844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:13.611337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:13.611764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:13.619718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:13.620338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:13.627269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:13.627760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:13.628200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:13.628903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:13.629363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:13.629788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:14.051091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:14.059853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:14.061293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:14.062459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-19aeb4f9-892c-4dd1-a58a-d06bb4ddc821 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.464225 Sep 19 11:51:14.063012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1408/2786] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:14.067502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:14.068105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:14.072759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:14.075215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:14.075960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:14.076398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:14.077095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:14.077547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:14.077968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:14.082307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-08ab21b0-8b6e-432e-be73-2e67be6d48e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.466417 Sep 19 11:51:14.083821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1379/2787] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:14.205376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:14.213652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe9dd116-0419-4bf3-8afe-adf6292d9fff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149642 Sep 19 11:51:14.214792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1409/2788] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:14 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:15.091720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:15.092334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:15.098735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:15.099262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:15.099711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:15.100402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:15.100871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:15.101298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:15.107035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:15.107693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:15.114122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:15.114605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:15.115043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:15.115860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:15.116319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:15.116744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:15.308983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:15.309275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:15.324943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:15.326380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:15.327584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-47f96fc1-203f-4b6b-8b9f-a5a2f59ab458 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.239785 Sep 19 11:51:15.328349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1380/2789] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:15.343975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:15.343975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:15.352480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bd7954e9-920b-4eb0-8259-1029448161ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.249727 Sep 19 11:51:15.353497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1410/2790] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:15.354526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:15.356032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:15.363419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:15.363419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:15.363419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:15.363419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:15.492606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:15.500886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c5babb88-6b61-4a3b-b2f0-39ed199df6e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.171753 Sep 19 11:51:15.501461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1381/2791] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:15 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:16.358283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:16.360034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:16.362461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=72 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:16.366123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:16.366618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:16.367285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:16.367992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:16.368449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:16.368894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:16.384670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:16.386065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:16.392243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=74 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:16.394332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:16.394479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:16.394791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:16.395857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:16.396499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:16.397094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:16.599671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:16.603549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:16.613190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-62f48c84-8971-43ac-9f57-bc34598f6a64 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.232223 Sep 19 11:51:16.614369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:16.616104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:16.617315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2496a870-93e6-4614-98e1-60b4cba40dd3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.263852 Sep 19 11:51:16.617864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1411/2793] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:16.622211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1382/2792] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:16.622939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:16.623764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:16.629829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:16.630584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:16.631210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:16.636714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:16.636714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:16.636714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:16.762386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:16.770608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1ccd87de-8777-43f4-80a3-0467744b068a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151797 Sep 19 11:51:16.771177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1412/2794] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:16 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:17.638545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:17.639139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:17.645732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:17.646015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:17.646445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:17.646589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:17.646730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:17.647361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:17.647815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:17.648242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:17.652663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:17.653142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:17.653574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:17.654256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:17.654718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:17.655122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:17.855052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:17.855238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:17.861023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-619b77cc-3b4f-4fc1-bcf1-b0fa08e6753e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.226802 Sep 19 11:51:17.861602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1383/2795] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:17.863659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:17.865105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:17.866064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:17.866271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fc0d3751-a703-4fc5-960e-aefa05ccf82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.224080 Sep 19 11:51:17.866673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:17.867240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1413/2796] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:17.873357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:17.873846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:17.874283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:17.874975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:17.875456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:17.876029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:18.004292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:18.012500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-336463e0-2b1a-4273-a88f-210e044e291d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149946 Sep 19 11:51:18.013063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1384/2797] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:17 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:18.884840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:18.885449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:18.893042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:18.893336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:18.893785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:18.893942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:18.894063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:18.894640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:18.895099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:18.895556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:18.900287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:18.900760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:18.901190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:18.901870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:18.902314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:18.902732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:19.037996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:19.047550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e6d5f237-5f0d-4d95-8ed0-e1d43d36efe2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.166439 Sep 19 11:51:19.048143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1414/2798] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:19.052657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:19.053493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:19.060900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:19.061380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:19.062016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:19.062703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:19.063366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:19.063789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:19.250747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:19.257808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:19.260091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:19.262116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:19.263319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4ecb63b7-0da9-4132-ba4a-70a76df948d0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.373921 Sep 19 11:51:19.263876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1385/2799] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:19.266765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c8f3c916-c371-49bc-93f1-635d4e76e801 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.217608 Sep 19 11:51:19.267373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1415/2800] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:19 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:20.072213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:20.072824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:20.079334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:20.079827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:20.080304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:20.080989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:20.081450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:20.081881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:20.209901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:20.218252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8bd50b2e-2b90-4743-bc1b-4fb2fd3f01b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149988 Sep 19 11:51:20.218810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1386/2801] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:20.289843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:20.290463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:20.290675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:20.291340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:20.297963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:20.298166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:20.298452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:20.298587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:20.298887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:20.299019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:20.299595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:20.299717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:20.300044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:20.300164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:20.300467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:20.300583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:20.496070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:20.500058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:20.503497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:20.504816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:20.506264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:20.507473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9223384e-1470-452e-8ac1-e54f78865f66 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220628 Sep 19 11:51:20.508030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1387/2802] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:20.508536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c85ecc88-2fa0-41b9-bf4e-1307b87c15b4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.222580 Sep 19 11:51:20.509111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1416/2803] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:20 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:21.241896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:21.242534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:21.248930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:21.249420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:21.249859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:21.250567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:21.251012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:21.251467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:21.381592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:21.385018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:21.390253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7d81f9ba-69e1-462b-812d-3e02ed8f67c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152261 Sep 19 11:51:21.390866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1388/2804] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:21.534114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:21.534802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:21.539977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:21.540589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:21.541573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:21.542342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:21.542784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:21.543518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:21.543976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:21.544406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:21.547231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:21.547712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:21.548146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:21.548831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:21.549280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:21.549700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:21.741184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:21.744156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:21.750585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:21.752136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:21.752441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9623659b-8dbc-43cf-b7a2-45a3fac4c086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216649 Sep 19 11:51:21.753010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1389/2805] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:21 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:21.753296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4381a816-0632-4d91-aac1-8fcf57592602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.223545 Sep 19 11:51:21.754574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1417/2806] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:22.414194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:22.414743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:22.422157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:22.422640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:22.423077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:22.423869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:22.424325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:22.424749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:22.560876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:22.569329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-55f49f7a-c43b-4ea4-8e0f-369586484584 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.159095 Sep 19 11:51:22.569903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1390/2807] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:22.776178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:22.776801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:22.779025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:22.779663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:22.784132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:22.784639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:22.785098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:22.785509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:22.785787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:22.785994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:22.786235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:22.786436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:22.786655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:22.787125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:22.787623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:22.788055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:22.976195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:22.984742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a6d1773d-936a-468c-a1a4-cecd35b0f004 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.212173 Sep 19 11:51:22.985146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1418/2808] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:22 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:22.986994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:22.995676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:22.997118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:22.998272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-420eec4c-d8c3-48f9-96db-497d499d879f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.223653 Sep 19 11:51:22.998823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1391/2809] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:23.593401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:23.594014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:23.599984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:23.600478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:23.600916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:23.601608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:23.602066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:23.602497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:23.737635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:23.748112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7fc7ed46-f864-46e0-92b5-5ace492bb92f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.159004 Sep 19 11:51:23.748584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1419/2810] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:24.007601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:24.008194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:24.015335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:24.015824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:24.016265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:24.016965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:24.017426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:24.017883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:24.024488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:24.025837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:24.033253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:24.033745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:24.034180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:24.035075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:24.035690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:24.036138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:24.284521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:24.293149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e831db9d-b056-4246-b9ef-f14e8c54c351 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.289493 Sep 19 11:51:24.293816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1392/2811] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:24 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:24.421850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:24.430436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:24.431848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:24.432996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7448da57-2da1-4fcc-909d-91f8179fb1ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.412495 Sep 19 11:51:24.434195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1420/2812] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:24.771688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:24.772321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:24.778361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:24.778839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:24.779312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:24.779991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:24.780438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:24.780853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:24.912008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:24.920935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e9d411e-0ec3-4cc8-8223-a7dd5956dfd3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.153080 Sep 19 11:51:24.921491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1393/2813] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:25.316828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:25.317439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:25.324077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:25.324571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:25.325014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:25.325710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:25.326165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:25.326592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:25.456388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:25.458963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:25.459607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:25.466444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:25.466669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6eb33ebd-0ba2-4588-96e7-fdda27de23e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153385 Sep 19 11:51:25.466931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:25.467605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1421/2814] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:25 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:25.467750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:25.469302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:25.469916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:25.470450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:25.608687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:25.617578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:25.619022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:25.620223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8b281ade-f17b-40c5-9fc3-59f9c3837ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.165170 Sep 19 11:51:25.620782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1394/2815] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:25.944740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:25.945392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:25.951931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:25.952428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:25.952873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:25.953575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:25.954038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:25.954501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:26.081903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:26.090171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8f461baa-26aa-4bc6-80c7-e183f9ca3ba0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149214 Sep 19 11:51:26.091363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1422/2816] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:26.489792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:26.490415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:26.497484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:26.497968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:26.498407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:26.499091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:26.499575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:26.500002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:26.630756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:26.639650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a1f63ea6-ef01-4aec-a1f2-ee0c5c65ea4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153711 Sep 19 11:51:26.649817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1395/2817] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:26 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:26.649967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:26.649967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:26.654651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:26.655872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:26.656328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:26.657439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:26.657921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:26.658623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:26.792365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:26.801573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:26.803015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:26.804264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2c558976-ca64-4aaf-9356-9871cc2ace35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.162414 Sep 19 11:51:26.804820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1423/2818] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:27.113996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:27.114645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:27.120810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:27.121321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:27.121763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:27.122572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:27.123034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:27.123499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:27.254261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:27.262784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0a962092-397d-498a-bfc8-63a342cb44ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152623 Sep 19 11:51:27.263385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1396/2819] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:27.672461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:27.673072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:27.679514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:27.680046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:27.680492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:27.681183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:27.681641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:27.682072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:27.813611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:27.821751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dcf99575-8e09-4d48-8245-a4d19fb907e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153767 Sep 19 11:51:27.822315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1424/2820] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:27 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:27.830069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:27.830771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:27.837409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:27.837897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:27.838339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:27.839028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:27.839533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:27.839963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:27.968655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:27.977747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:27.979206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:27.980389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9fccf324-cfdc-4ed5-ba53-c5bcaa6874c9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154289 Sep 19 11:51:27.980946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1397/2821] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:28.287607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:28.288238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:28.294380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:28.294852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:28.295317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:28.295997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:28.296456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:28.296867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:28.430409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:28.438561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5862ae50-3fb4-4494-b5e9-43497b1ad752 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.155149 Sep 19 11:51:28.439601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1425/2822] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:28.845153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:28.845831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:28.852396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:28.852884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:28.853325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:28.854018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:28.854477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:28.854902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:28.984514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:28.992690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6bdaf1db-9b3f-4588-88b0-c13fc647120f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151451 Sep 19 11:51:28.993285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1398/2823] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:28 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:29.005989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:29.006598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:29.013253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:29.013736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:29.014174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:29.014865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:29.015373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:29.015804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:29.147549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:29.156593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:29.158031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:29.159230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6f388fa8-03df-4ad4-b622-3bc8c03cf75c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157176 Sep 19 11:51:29.159802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1426/2824] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:29.461941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:29.468838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:29.469184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:29.469667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:29.470104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:29.470831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:29.471310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:29.471739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:29.619531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:29.627721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d67d7e14-461e-4305-bdf2-46ec16289fc7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.169682 Sep 19 11:51:29.628295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1399/2825] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:30.017003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:30.017621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:30.024146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:30.024628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:30.025066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:30.025764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:30.026219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:30.026649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:30.158046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:30.166195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e76e22f1-94e6-4ffd-9783-ccf0b0d46a4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153589 Sep 19 11:51:30.167030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1427/2826] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:30 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:30.187331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:30.187933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:30.194263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:30.194741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:30.195189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:30.195894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:30.196341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:30.196760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:30.329874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:30.338650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:30.340117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:30.341281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-83f847e5-5006-476a-a1a2-2b06f3e86da7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158387 Sep 19 11:51:30.341839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1400/2827] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:30.651206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:30.651775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:30.657712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:30.658199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:30.658647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:30.659376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:30.659836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:30.660265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:30.801421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:30.809759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b10943cd-5e95-459d-bde5-261e6ae5e1fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.162429 Sep 19 11:51:30.810825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1428/2828] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:31.189675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:31.190271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:31.197254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:31.197736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:31.198175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:31.198894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:31.199379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:31.199807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:31.329775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:31.338034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7885aeaa-66be-423c-b4ca-f898b73d1121 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152237 Sep 19 11:51:31.338597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1401/2829] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:31 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:31.368063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:31.368669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:31.375209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:31.375710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:31.376134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:31.376820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:31.377272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:31.377696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:31.508993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:31.518218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:31.519695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:31.520854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1d8e7de5-b406-4c1c-9872-86d33600715b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157446 Sep 19 11:51:31.521595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1429/2830] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:31.833478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:31.834085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:31.840107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:31.840588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:31.841028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:31.841711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:31.842160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:31.842585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:31.972716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:31.981031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f3c66ef9-cbcc-4bed-93d5-e564c3674103 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151416 Sep 19 11:51:31.981605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1402/2831] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:32.362318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:32.362917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:32.368975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:32.369568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:32.369897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:32.370577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:32.371027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:32.371478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:32.502803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:32.511028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f9d4b7fc-2f16-4ba0-81c6-097926541f90 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152582 Sep 19 11:51:32.511623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1430/2832] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:32 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:32.548021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:32.548633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:32.555073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:32.555569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:32.556007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:32.556696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:32.557156 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:32.557583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:32.684680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:32.694223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:32.695708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:32.696886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-80478f9d-e03e-42bb-973b-b1559a88e80e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153457 Sep 19 11:51:32.697445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1403/2833] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:33.005078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:33.005696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:33.011705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:33.012191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:33.012627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:33.013810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:33.014270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:33.014744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:33.146615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:33.154787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-151532ed-37d2-4f2a-872b-4e716a10cc99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.153928 Sep 19 11:51:33.155364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1431/2834] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:33.533446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:33.534052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:33.540237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:33.540715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:33.541148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:33.542097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:33.542546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:33.542961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:33.674825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:33.683136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e2af8203-d83e-4972-a38b-0259b9fc43ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153510 Sep 19 11:51:33.683759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1404/2835] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:33 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:33.725953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:33.726647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:33.733634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:33.734152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:33.734631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:33.735377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:33.735838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:33.736267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:33.866418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:33.875951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:33.877433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:33.878578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0ae24fd7-ae22-46af-ba2b-dc1c64ecd9cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156611 Sep 19 11:51:33.879253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1432/2836] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:34.178554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:34.179185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:34.185230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:34.185725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:34.186172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:34.187181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:34.187647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:34.188078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:34.206728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:34.322861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:34.331597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4b6ac977-c843-4e00-8316-5cdbb8da8279 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.156920 Sep 19 11:51:34.332169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1405/2837] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:34.709659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:34.710321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:34.721148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:34.721635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:34.722075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:34.722768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:34.723248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:34.723679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:34.742898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:34.852764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:34.860992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6895623a-9032-4e84-9f6e-ee89370df130 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157269 Sep 19 11:51:34.861551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1433/2838] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:34 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:34.904649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:34.905294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:34.911780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:34.912262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:34.912697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:34.913385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:34.913839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:34.914268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:35.045388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:35.054554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:35.056041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:35.057237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9a77d99c-c9d6-44c8-aaf5-e0bb204974fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156633 Sep 19 11:51:35.057784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1406/2839] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:35.355615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:35.356219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:35.362815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:35.363332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:35.363764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:35.364445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:35.364891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:35.365312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:35.491917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:35.500089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-796b1f36-c7c8-461b-a834-143cfe616f33 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.148406 Sep 19 11:51:35.500654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1434/2840] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:35.884413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:35.885057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:35.891586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:35.892070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:35.892509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:35.893194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:35.893650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:35.894072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:36.022914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:36.031540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-711737bc-b459-4721-af48-0001f04b2f21 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150914 Sep 19 11:51:36.032118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1407/2841] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:35 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:36.082923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:36.083566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:36.090097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:36.090582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:36.091022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:36.091751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:36.092211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:36.092650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:36.226424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:36.235049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:36.236560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:36.237729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b3e636bb-4801-416e-a918-dd3def792ad6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158715 Sep 19 11:51:36.238292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1435/2842] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:36.523343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:36.523960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:36.530072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:36.530552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:36.530999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:36.531714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:36.532174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:36.532603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:36.660425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:36.668943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-24c669cb-b357-4265-8b86-8254ea8bb856 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149562 Sep 19 11:51:36.669507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1408/2843] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:37.053963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:37.054575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:37.061006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:37.061495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:37.062238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:37.062930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:37.063421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:37.063855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:37.195191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:37.203960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c36257c7-69f4-472a-85fe-24ef5e9178d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153924 Sep 19 11:51:37.204723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1436/2844] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:37 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:37.263638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:37.264254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:37.271312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:37.271799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:37.272239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:37.272931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:37.273387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:37.273816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:37.402081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:37.411423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:37.412878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:37.414059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c3a8a605-20b1-492c-adb1-aacadc2e97ce tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154299 Sep 19 11:51:37.414631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1409/2845] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:37.693739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:37.694285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:37.700399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:37.700886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:37.701930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:37.702035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:37.703150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:37.703612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:37.834080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:37.842230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f27e6dde-c9d4-46d6-bbf4-69282c42db0f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152708 Sep 19 11:51:37.843312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1437/2846] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:38.227898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:38.228510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:38.234518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:38.235005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:38.235481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:38.236171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:38.236631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:38.237059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:38.365008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:38.373324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c2d20c96-91a0-429f-b38d-339b06617074 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149270 Sep 19 11:51:38.373836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1410/2847] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:38 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:38.440366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:38.440979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:38.447496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:38.447980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:38.448420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:38.449112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:38.449572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:38.450003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:38.578328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:38.586877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:38.588354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:38.589521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f6462c55-cdb3-415f-a6cb-cac1114fe3db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153578 Sep 19 11:51:38.590071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1438/2848] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:38.865860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:38.866477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:38.872579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:38.873064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:38.873504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:38.874811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:38.875297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:38.875767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:39.004944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:39.013302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-85618293-9625-4f26-9145-3a1820788664 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151386 Sep 19 11:51:39.013877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1411/2849] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:39.397244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:39.397811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:39.403836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:39.404324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:39.404764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:39.406154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:39.406593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:39.407024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:39.532504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:39.540764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aca654f9-1bfc-461a-a457-2d4c05dd0509 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.147491 Sep 19 11:51:39.541597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1439/2850] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:39 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:39.615618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:39.616251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:39.622587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:39.623062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:39.623531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:39.624233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:39.624685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:39.625099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:39.754914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:39.763533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:39.765012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:39.766169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0f96e03f-2978-4fe6-b4c9-5e60707cc73a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154426 Sep 19 11:51:39.766727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1412/2851] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:40.037135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:40.037751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:40.044064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:40.044553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:40.044996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:40.045685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:40.046711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:40.047150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:40.173674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:40.181876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-db20912d-9217-4ae0-b5c0-d2ed25851e4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.148659 Sep 19 11:51:40.182441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1440/2852] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:40.564875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:40.565492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:40.571567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:40.572055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:40.572495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:40.573186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:40.573643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:40.574076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:40.698739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:40.707591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e964a9f-858d-44bf-90b4-c53251892145 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.147102 Sep 19 11:51:40.708149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1413/2853] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:40 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:40.793480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:40.794083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:40.800548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:40.801163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:40.801572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:40.802252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:40.802702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:40.803126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:40.935573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:40.944160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:40.945586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:40.946734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf5a166d-dac9-4050-aa95-c56cf3fe00be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157493 Sep 19 11:51:40.947306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1441/2854] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:41.205629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:41.206167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:41.212256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:41.212753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:41.213197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:41.213883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:41.214339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:41.214768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:41.344972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:41.353100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2a4543ce-c90e-4c61-94e0-16ee5bd74523 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152007 Sep 19 11:51:41.353657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1414/2855] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:41.730875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:41.731519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:41.737515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:41.738001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:41.738449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:41.739140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:41.739620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:41.740178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:41.869302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:41.877991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b1683b56-848a-4dea-bebf-e8027607fe75 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151017 Sep 19 11:51:41.878547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1442/2856] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:41 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:41.972512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:41.973073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:41.979604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:41.980093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:41.980532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:41.981255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:41.981745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:41.982168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:42.113195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:42.121973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:42.123507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:42.124663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9edb40da-4a19-472c-9dff-b7b979927465 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156246 Sep 19 11:51:42.125746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1415/2857] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:42.376608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:42.377221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:42.383219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:42.383708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:42.384148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:42.384838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:42.385291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:42.385719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:42.514965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:42.523302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6c1ce0fd-d222-4764-93dc-11c47dc84109 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151194 Sep 19 11:51:42.523881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1443/2858] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:42.901734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:42.902339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:42.908911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:42.909388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:42.909818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:42.910492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:42.910940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:42.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:43.038292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:43.047877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-69c8f5fa-912e-44ba-9c3b-27fa49df25d0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149108 Sep 19 11:51:43.047877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1416/2859] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:42 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:43.151524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:43.152186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:43.158552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:43.159030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:43.159499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:43.160182 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:43.160636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:43.161069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:43.288058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:43.296980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:43.298423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:43.299612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-953d48d6-6e96-49a5-8a40-d27f528686b9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152078 Sep 19 11:51:43.300216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1444/2860] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:43.548128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:43.548746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:43.554706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:43.555214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:43.555656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:43.556375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:43.556798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:43.557224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:43.687045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:43.695890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce7c463f-c052-451f-a27b-37f5fa2770ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152108 Sep 19 11:51:43.696476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1417/2861] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:44.069391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:44.069998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:44.076064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:44.076543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:44.076977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:44.077657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:44.078107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:44.078553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:44.205127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:44.213548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0a47fa15-823f-40aa-bb63-111098519ac5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.147927 Sep 19 11:51:44.214131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1445/2862] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:44 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:44.326072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:44.326610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:44.333541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:44.334013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:44.334448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:44.335127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:44.335601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:44.336023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:44.467899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:44.477514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:44.479098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:44.480281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-200993f8-c3e1-4fc3-ab70-590f0190ef68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158334 Sep 19 11:51:44.480839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1418/2863] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:44.720162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:44.720712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:44.726626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:44.727113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:44.727595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:44.728284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:44.728743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:44.729176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:44.862789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:44.870934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9c8b7207-f3d0-460b-a878-db25eb764ae9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.154825 Sep 19 11:51:44.871536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1446/2864] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:45.237985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:45.238600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:45.244592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:45.245075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:45.245512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:45.246189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:45.246642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:45.247063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:45.377244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:45.385506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54435906-91cd-4894-973a-013b58d357f2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151894 Sep 19 11:51:45.386075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1419/2865] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:45 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:45.506005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:45.506612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:45.513136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:45.513613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:45.514051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:45.514735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:45.515219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:45.515652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:45.646547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:45.655474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:45.657453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:45.658605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5884abb1-41ad-4c8e-9b0b-6d30927af446 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156583 Sep 19 11:51:45.659197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1447/2866] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:45.895058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:45.895614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:45.901542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:45.902025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:45.902456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:45.903130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:45.903602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:45.904020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:46.029862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:46.038657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cd746d55-6103-4b62-91fa-db65fa54d3c7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.148011 Sep 19 11:51:46.039250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1420/2867] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:46.408774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:46.409376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:46.411818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=74 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:46.416768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:46.417249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:46.417680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:46.418428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:46.418875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:46.419328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:46.572365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:46.572365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e566d891-3200-42ff-bd88-0ed8917bba1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159164 Sep 19 11:51:46.572365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1448/2868] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:46 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:46.685159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:46.685756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:46.688402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=78 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:46.693101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:46.693677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:46.694125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:46.694805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:46.695285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:46.695711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:46.828720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:46.837378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:46.838818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:46.840086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7590eaed-37f0-4615-8a16-23285af538be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159013 Sep 19 11:51:46.840646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1421/2869] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:47.062590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:47.063300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:47.072231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:47.072675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:47.073123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:47.073836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:47.074305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:47.074737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:47.206448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:47.214722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3d6b2184-a1cb-4c4a-84ce-14a96f10eeb1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.156200 Sep 19 11:51:47.219402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1449/2870] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:51:47.588220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:47.588839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:47.595553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:47.596072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:47.596517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:47.597204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:47.597668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:47.598102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:47.602200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:47.728586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:47.736949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-309c2117-7a46-445e-8941-cdb254e835a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152772 Sep 19 11:51:47.737526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1422/2871] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:47 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:47.865666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:47.866253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:47.872293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:47.872767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:47.873196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:47.873871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:47.874315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:47.874736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:47.879181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:51:48.004153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:48.012815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:48.014356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:48.016148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6d812be1-634c-4183-a05e-5c81ba70093f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153897 Sep 19 11:51:48.016717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1450/2872] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:48.241229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:48.241843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:48.247800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:48.248286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:48.248722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:48.249402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:48.249865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:48.250915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:48.621873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:48.630261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-95ebec6e-32c1-4829-bc2b-3a8d21744536 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.392901 Sep 19 11:51:48.630830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1423/2873] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:48.761310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:48.761920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:48.768527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:48.769011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:48.769448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:48.770138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:48.770591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:48.771015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:48.903522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:48.912854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3560552-77d1-4aa5-8994-f8fd8bc52b3d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155544 Sep 19 11:51:48.913429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1451/2874] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:48 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:49.044054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:49.044649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:49.052874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:49.053355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:49.053842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:49.054524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:49.055802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:49.056284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:49.189872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:49.198378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:49.199833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:49.200977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3e0df8c8-a45d-4b61-8c57-baa6a89c1eab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.162405 Sep 19 11:51:49.201527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1424/2875] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:49.655845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:49.657020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:49.662869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:49.663380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:49.663815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:49.664489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:49.664976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:49.665412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:49.790096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:49.798681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-88040205-3748-4f2a-9932-8e7020e7bc3f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.146668 Sep 19 11:51:49.799263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1452/2876] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:49.936159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:49.936679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:49.943142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:49.943660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:49.944088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:49.944761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:49.945209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:49.945669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:50.076647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:50.085484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-04041002-0916-41a3-9678-b0ade6369ee1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153212 Sep 19 11:51:50.086053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1425/2877] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:49 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:50.226401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:50.226931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:50.233394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:50.233883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:50.234344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:50.235032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:50.235517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:50.235952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:50.364864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:50.373583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:50.375675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:50.376855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e79372cd-c1ce-4a11-8b60-4c3a35a32d46 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154498 Sep 19 11:51:50.377453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1453/2878] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:50.821881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:50.822653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:50.828837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:50.829611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:50.829943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:50.831890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:50.832396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:50.832838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:50.970480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:50.979065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-949431b8-a271-4fd5-805d-862eb2a2a843 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.161202 Sep 19 11:51:50.979677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1426/2879] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:51.110227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:51.111330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:51.119125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:51.119958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:51.120449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:51.125662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:51.125662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:51.125662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:51.264990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:51.274019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5d027a7b-91a8-496c-9c45-2b409782b75b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.169078 Sep 19 11:51:51.274609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1454/2880] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:51 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:51.403862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:51.404430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:51.411790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:51.412346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:51.412847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:51.413834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:51.414289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:51.414713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:51.559751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:51.569362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:51.572828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:51.572828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fc76226f-ef10-4404-a343-3a4f221b0147 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.172869 Sep 19 11:51:51.572828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1427/2881] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:52.002099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:52.002759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:52.009441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:52.009931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:52.010377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:52.011236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:52.011550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:52.011980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:52.148332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:52.157434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-19f79562-a4e0-4342-adc9-6abf23fa4362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.159359 Sep 19 11:51:52.158009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1455/2882] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:52.298183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:52.298803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:52.304782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:52.305263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:52.305696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:52.306401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:52.306854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:52.307307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:52.441136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:52.449349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-293feab6-b589-4253-96c7-e354e99c672b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155633 Sep 19 11:51:52.449909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1428/2883] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:52 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:52.598546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:52.599096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:52.605430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:52.605906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:52.606342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:52.607017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:52.607500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:52.607920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:52.734882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:52.743544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:52.744993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:52.746169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7e238303-eab4-43f8-89e8-45e0f8d46049 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.151645 Sep 19 11:51:52.746732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1456/2884] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:53.180816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:53.181434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:53.187508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:53.188000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:53.188443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:53.189128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:53.189589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:53.190020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:53.321196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:53.330160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7c8def1c-ab59-4d10-9620-e0d4b42336b1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.153203 Sep 19 11:51:53.330739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1429/2885] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:53.473261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:53.473800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:53.479809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:53.480299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:53.480739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:53.481433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:53.481893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:53.482327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:53.611872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:53.620000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-49cc1871-4fa1-46b8-8ed6-608a93624c24 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151276 Sep 19 11:51:53.620601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1457/2886] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:53 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:53.772830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:53.773450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:53.780803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:53.781331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:53.781788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:53.782480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:53.782933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:53.783398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:53.916329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:53.924998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:53.926435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:53.927632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7c40908-5eaa-47d7-822e-a6498a801501 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158809 Sep 19 11:51:53.928200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1430/2887] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:54.353851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:54.354633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:54.361014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:54.361502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:54.361944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:54.362641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:54.363101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:54.363561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:54.492854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:54.501615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b2fe6424-9ef2-4fac-ad32-03e935efa5a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151936 Sep 19 11:51:54.502178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1458/2888] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:54.644280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:54.644918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:54.650903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:54.651424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:54.651868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:54.652550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:54.653004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:54.653430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:54.785717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:54.794204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6ed88b57-fa1c-48ca-90a2-d03b57706090 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154353 Sep 19 11:51:54.794775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1431/2889] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:54 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:54.953956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:54.954643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:54.961368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:54.961854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:54.962299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:54.962991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:54.963471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:54.963903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:55.092492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:55.101239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:55.102682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:55.103876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8d52160c-8789-4bdb-aefc-29d7c78faba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154001 Sep 19 11:51:55.104440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1459/2890] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:55.526324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:55.526941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:55.529034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:51:55.529240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:51:55 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 (ip 10.222.0.78) !!! Sep 19 11:51:55.536380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:55.536866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:55.537305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:55.538008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:55.538466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:55.538900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:55.670637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:55.678943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-682bc719-c456-48a6-8164-09df1bc57712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.156610 Sep 19 11:51:55.679545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1432/2891] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:55.817821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:55.818365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:55.825301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:55.825786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:55.826403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:55.827102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:55.827590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:55.828520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:55.962812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:55.971283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e8b25dbc-e98b-4f0e-a810-eeef52acc9bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157480 Sep 19 11:51:55.971864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1460/2892] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:55 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:56.130397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:56.131011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:56.137462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:56.137947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:56.138389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:56.139075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:56.139560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:56.139991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:56.267854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:56.276415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:56.277858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:56.279003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8fa30180-1c54-4c22-bbb0-c1ae1d0470f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152657 Sep 19 11:51:56.279602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1433/2893] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:51:56.701742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:56.702356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:56.708435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:56.708922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:56.709363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:56.710053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:56.710519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:56.710949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:56.845514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:56.853698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb016f9a-4941-434f-932a-e5c9b2902452 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.155856 Sep 19 11:51:56.854292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1461/2894] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:56.993975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:56.994500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:57.000692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:57.001169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:57.001594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:57.002311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:57.002760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:57.003195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:57.132886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:57.142078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff14e811-d786-4fb6-8d3e-f28bce8ff5d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152045 Sep 19 11:51:57.142645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1434/2895] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:56 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:57.304544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:57.305151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:57.311701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:57.312190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:57.312631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:57.313320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:57.313777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:57.314209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:57.443068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:57.451801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:57.453885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:57.455089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-273db6d9-5e11-42ed-874a-e3d2ea6477fc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154526 Sep 19 11:51:57.455681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1462/2896] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:57.878145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:57.878762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:57.884900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:57.885386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:57.885824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:57.886512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:57.886973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:57.887458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:58.018370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:58.026685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30d55189-6680-4707-821a-530a23016311 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.153102 Sep 19 11:51:58.029492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1435/2897] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:58.166278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:58.166892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:58.173824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:58.174368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:58.174811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:58.175547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:58.176005 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:58.176434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:58.304821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:58.313025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cec6e953-c3c7-496d-a822-ae311b1b6d5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151029 Sep 19 11:51:58.313588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1463/2898] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:58 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:58.482099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:58.482752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:58.489993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:58.490477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:58.490963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:58.491635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:58.492097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:58.492519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:58.622828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:58.631430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:58.632865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:58.634026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d61f06df-c34e-4105-9717-c6f2c2d7b57d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155863 Sep 19 11:51:58.634578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1436/2899] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:51:59.049981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:59.050586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:59.056753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:59.057231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:59.057661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:59.058342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:59.058784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:59.059232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:59.186538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:59.195730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-24c4bf2e-a0ce-4512-a3a7-90d7d2b01b0b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149808 Sep 19 11:51:59.196309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1464/2900] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:59.336604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:59.337134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:59.343100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:59.343631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:59.344071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:59.344768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:59.345222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:59.345649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:59.484394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:59.488242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e1ebd91-de21-43a7-9eb0-61ac6fee0436 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155752 Sep 19 11:51:59.488812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1437/2901] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:51:59 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:51:59.660875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:51:59.661460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:51:59.668226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:59.668705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:59.669143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:59.669819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:51:59.670268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:51:59.670690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:51:59.801149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:59.809827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:59.811304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:51:59.812516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-71fdd41c-88ad-440f-a91f-fd08c08cfba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155697 Sep 19 11:51:59.813079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1465/2902] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:51:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:00.219650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:00.220264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:00.226199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:00.226685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:00.227132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:00.227842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:00.228305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:00.228733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:00.360671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:00.364084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:00.369143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-610d7d55-c3de-491f-9bc5-8d628af875f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.153337 Sep 19 11:52:00.369645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1438/2903] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:00.512110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:00.512723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:00.518722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:00.519231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:00.519681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:00.520367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:00.520823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:00.521250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:00.651820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:00.655219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:00.660725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2d4d57a4-917c-4749-baf9-fc9b2794e76f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152605 Sep 19 11:52:00.661303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1466/2904] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:00 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:00.838094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:00.838704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:00.845791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:00.846317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:00.846763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:00.847558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:00.848020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:00.848450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:00.982128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:00.990711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:00.992199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:00.993367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e1fbe1b6-f361-4eb1-bda3-970d0778cc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159679 Sep 19 11:52:00.993921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1439/2905] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:01.394072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:01.394682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:01.401785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:01.402272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:01.402711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:01.403442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:01.403897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:01.404325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:01.535912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:01.544371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e36400cd-e910-491d-ad5b-1fa863232be5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.154887 Sep 19 11:52:01.544946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1467/2906] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:01.690574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:01.691197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:01.697201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:01.697764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:01.698207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:01.698899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:01.699390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:01.699820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:01.828208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:01.836512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4558ca4a-c15c-45e7-9bbe-5f822c29a14d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150457 Sep 19 11:52:01.837086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1440/2907] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:01 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:02.018946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:02.019603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:02.025500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:02.025977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:02.026412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:02.027151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:02.027590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:02.028007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:02.157170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:02.166061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:02.167545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:02.168718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-90df567f-f2c7-4e47-a456-820de81fd905 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153649 Sep 19 11:52:02.169281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1468/2908] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:02.568557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:02.569165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:02.575500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:02.576058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:02.576495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:02.577169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:02.578128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:02.578545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:02.707845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:02.716021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42469610-4453-4ee3-8fb6-30abc707272c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151276 Sep 19 11:52:02.716594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1441/2909] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:02.859861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:02.860374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:02.866701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:02.867196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:02.867645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:02.868324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:02.868768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:02.869188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:03.004556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:03.012795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-54d28471-ff8c-4497-a26f-af152be07ef2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156842 Sep 19 11:52:03.013367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1469/2910] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:02 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:03.194263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:03.194868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:03.200855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:03.201336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:03.201768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:03.202456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:03.202903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:03.203358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:03.334809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:03.343574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:03.345138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:03.346281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-91c7f2eb-f946-434d-a1f6-ca3e24551ad5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155926 Sep 19 11:52:03.346838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1442/2911] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:03.739363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:03.739986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:03.745937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:03.746427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:03.746867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:03.747719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:03.748246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:03.748682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:03.876692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:03.884938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fea32d56-7cd7-451c-bf76-ccad661454ba tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149731 Sep 19 11:52:03.885511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1470/2912] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:04.035940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:04.036557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:04.043380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:04.043871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:04.044315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:04.045026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:04.045467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:04.045899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:04.181416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:04.189622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-57eb1a6b-cb94-43e3-93fa-57db288db282 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157612 Sep 19 11:52:04.190188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1443/2913] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:04 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:04.372711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:04.373265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:04.379534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:04.380028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:04.380469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:04.381162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:04.381638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:04.382046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:04.516655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:04.525458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:04.526892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:04.528206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-adf82bb3-af18-4f0c-a129-54473df80f21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159495 Sep 19 11:52:04.529032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1471/2914] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:04.908197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:04.908811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:04.914788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:04.915578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:04.916019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:04.916707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:04.917163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:04.917592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:05.047689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:05.055849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d819e596-d710-4442-9127-e2e43b935883 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.151507 Sep 19 11:52:05.056412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1444/2915] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:05.212151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:05.212715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:05.219091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:05.219606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:05.220048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:05.220738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:05.221196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:05.221625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:05.356759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:05.365650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6ca0e486-6fd8-43da-8ee6-67197c51278e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157416 Sep 19 11:52:05.366215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1472/2916] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:05 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:05.554069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:05.554730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:05.560761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:05.561248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:05.561724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:05.562417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:05.562909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:05.563372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:05.691881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:05.700527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:05.701974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:05.703190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c5f7b3aa-ea11-44f0-99bb-a62cb4a25803 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153137 Sep 19 11:52:05.703765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1445/2917] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:06.079910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:06.080528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:06.086760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:06.087301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:06.087745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:06.088438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:06.088898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:06.089337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:06.225563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:06.233899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-837a03de-93c8-4996-93ab-552cec7a87f0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.158387 Sep 19 11:52:06.234464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1473/2918] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:06.390053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:06.390606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:06.397836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:06.398405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:06.398778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:06.399511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:06.399966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:06.400390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:06.530408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:06.538829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-843caace-ab0d-4171-b428-6f676d411965 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153139 Sep 19 11:52:06.539431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1446/2919] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:06 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:06.729652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:06.730186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:06.736113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:06.736600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:06.737038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:06.737724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:06.738183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:06.738613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:06.867063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:06.876449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:06.877899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:06.879067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6af9a6ef-3619-4019-8896-216ce9f1d664 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153442 Sep 19 11:52:06.879659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1474/2920] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:07.257295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:07.257897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:07.263978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:07.264454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:07.264962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:07.265643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:07.266088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:07.266508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:07.397955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:07.406724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-93d2aeeb-bc60-4238-a82a-c0834f062e3c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.153308 Sep 19 11:52:07.407319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1447/2921] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:07.561652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:07.562295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:07.568897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:07.576072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:07.576072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:07.576072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:07.576072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:07.576491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:07.703215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:07.711775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad664959-47b6-4666-9f1c-cc94e86c53a2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153987 Sep 19 11:52:07.712348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1475/2922] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:07 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:07.905529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:07.906091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:07.912227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:07.912743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:07.913180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:07.913867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:07.914320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:07.914748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:08.048483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:08.057184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:08.058628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:08.059818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a97f1392-2435-477b-b8c7-f69943f88537 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158383 Sep 19 11:52:08.060382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1448/2923] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:08.430485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:08.431131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:08.437729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:08.438211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:08.438651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:08.439368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:08.439826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:08.440256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:08.567607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:08.576507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-76a293d3-416a-4f6b-832a-e24fde83a7d3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149919 Sep 19 11:52:08.577075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1476/2924] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:08.736070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:08.736638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:08.742904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:08.743416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:08.743851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:08.744529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:08.744979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:08.745396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:08.880741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:08.884206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-90a8d524-9a2e-49ca-a48c-7a97c452c287 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152714 Sep 19 11:52:08.884778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1449/2925] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:08 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:09.086455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:09.087068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:09.093632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:09.094125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:09.094563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:09.095296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:09.095761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:09.096189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:09.223470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:09.231955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:09.233379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:09.234533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5f76bc98-82a7-4578-9efa-4e7ca964ea35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152124 Sep 19 11:52:09.235092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1477/2926] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:09.599788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:09.600389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:09.606313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:09.606791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:09.607257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:09.607929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:09.608391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:09.608814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:09.735524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:09.743780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0fb0c0aa-575b-4725-91a7-ba0e0ea88dbb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.147846 Sep 19 11:52:09.744339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1450/2927] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:09.908477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:09.909132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:09.918203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:09.919131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:09.919974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:09.921371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:09.921851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:09.922288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:10.054999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:10.063795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d6cf64b0-fa57-465a-ac5e-2c6c12bb0df6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159953 Sep 19 11:52:10.064361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1478/2928] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:09 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:10.260074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:10.260690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:10.266651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:10.267133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:10.267605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:10.268286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:10.268740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:10.269164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:10.399152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:10.408623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:10.410060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:10.411253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d628dfb-299c-4e00-ae69-6d327401db04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155129 Sep 19 11:52:10.411814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1451/2929] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:10.768268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:10.768877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:10.775060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:10.775650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:10.776096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:10.776823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:10.777342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:10.777820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:10.909146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:10.917980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7bf385e1-f0d4-415c-a1df-239e4f3a84c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.154182 Sep 19 11:52:10.918548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1479/2930] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:11.085989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:11.086544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:11.093031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:11.093542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:11.093978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:11.094666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:11.095152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:11.095604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:11.224034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:11.232167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b9ad341a-50f7-436f-82fd-c6ff05839bcb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150158 Sep 19 11:52:11.232737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1452/2931] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:11 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:11.438752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:11.439293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:11.445285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:11.445764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:11.446202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:11.446885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:11.447406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:11.447836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:11.577292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:11.586129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:11.587603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:11.588800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b57118c5-cf8c-4e68-aa1e-5040333e529d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154689 Sep 19 11:52:11.589367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1480/2932] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:11.944231 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:11.944851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:11.950834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:11.951374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:11.951810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:11.952504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:11.952956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:11.953379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:12.093463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:12.097778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-15bc53f6-038b-40c1-b74f-f0b19260ae99 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.157389 Sep 19 11:52:12.098461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1453/2933] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:12.255475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:12.256144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:12.262620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:12.263103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:12.263579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:12.264274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:12.265300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:12.265736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:12.395073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:12.403482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2943b2a3-c159-4309-9430-cd5145e4b49f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151936 Sep 19 11:52:12.404057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1481/2934] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:12 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:12.614576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:12.615107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:12.621084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:12.621570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:12.622008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:12.622692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:12.623146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:12.623599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:12.753210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:12.762043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:12.763514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:12.765188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2f0f3512-4e8d-44c4-ab9d-27130ab427df tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154155 Sep 19 11:52:12.765751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1454/2935] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:13.121367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:13.121981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:13.128501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:13.128986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:13.129426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:13.130114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:13.130571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:13.131000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:13.260737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:13.270381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2c3362dd-53b1-439e-a815-e60c26087fdd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.152875 Sep 19 11:52:13.271003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1482/2936] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:13.427194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:13.427733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:13.434258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:13.434736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:13.435193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:13.435922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:13.437008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:13.437434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:13.455848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:13.574260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:13.582378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-55476cb1-4681-400d-a9c8-263bb01ab87e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159189 Sep 19 11:52:13.582936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1455/2937] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:13 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:13.792013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:13.792627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:13.799299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:13.799780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:13.800224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:13.800925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:13.801383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:13.801817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:13.821616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:13.932739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:13.941337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:13.942765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:13.944020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7475f3d4-cc64-4c71-831f-b30dc5cfeccd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156277 Sep 19 11:52:13.944581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1483/2938] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:52:14.294248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:14.294866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:14.300930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:14.301410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:14.301846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:14.302534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:14.302995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:14.303458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:14.431247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:14.439969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54cc59e0-8810-462d-91b5-8d454847ddeb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.149955 Sep 19 11:52:14.440595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1456/2939] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:14.605263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:14.605868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:14.612305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:14.612781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:14.613215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:14.613886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:14.614333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:14.614753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:14.745616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:14.754383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cc8ca999-d7a3-4640-9c09-e419710ff3e2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153015 Sep 19 11:52:14.754944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1484/2940] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:14 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:14.969798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:14.970324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:14.976370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:14.976860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:14.977304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:14.977986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:14.978446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:14.978904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:15.225175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:15.233988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:15.235475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:15.236649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-837caa37-8422-4560-b540-570760fe34d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.270922 Sep 19 11:52:15.237206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1457/2941] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:15.590856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:15.591531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:15.603706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:15.603706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:15.603706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:15.603706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:15.604088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:15.604088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:15.735962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:15.744216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c93cd87d-c61c-4369-ae61-2a98c95e6500 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.284089 Sep 19 11:52:15.744786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1485/2942] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:15.777786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:15.778429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:15.784982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:15.785467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:15.785908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:15.786599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:15.787059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:15.787519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:15.923716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:15.932160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d0f34fe-4e83-48cd-962a-836a95a5787c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.158240 Sep 19 11:52:15.932734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1458/2943] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:15 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:16.261795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:16.262463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:16.268820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:16.269308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:16.269749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:16.270478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:16.270936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:16.271543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:16.399696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:16.409014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:16.410539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:16.411743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b34e075e-f610-4165-84d7-c3cebf446955 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153926 Sep 19 11:52:16.412334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1486/2944] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:16.769745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:16.770361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:16.772418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=76 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:16.777164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:16.777659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:16.778095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:16.778840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:16.779332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:16.779766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:16.940240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:16.953189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0d58e6dc-6412-4fd9-a0da-9f2908a50dff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1601 microversion: 2.1 time: 0.187285 Sep 19 11:52:16.953685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1459/2945] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1601 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:16.959676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:16.960295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:16.962761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=78 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:16.967912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:16.968267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:16.968707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:16.969406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:16.969852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:16.978339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:17.086147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-624147cd-deb8-46b4-be99-74b52c859bb9 req-a3ef6332-fc28-461f-9924-7b2cbe84e25e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "416dd466-0154-4d9a-af4a-9f87010ce3a3", "name": "network-vif-deleted", "tag": "6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:52:17.097855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-624147cd-deb8-46b4-be99-74b52c859bb9 req-a3ef6332-fc28-461f-9924-7b2cbe84e25e service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:17.098342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-624147cd-deb8-46b4-be99-74b52c859bb9 req-a3ef6332-fc28-461f-9924-7b2cbe84e25e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:17.098778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-624147cd-deb8-46b4-be99-74b52c859bb9 req-a3ef6332-fc28-461f-9924-7b2cbe84e25e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:17.111670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-624147cd-deb8-46b4-be99-74b52c859bb9 req-a3ef6332-fc28-461f-9924-7b2cbe84e25e service nova] Creating event network-vif-deleted:6b6362ce-43f3-4aa7-bce0-ae0b92a6ffa7 for instance 416dd466-0154-4d9a-af4a-9f87010ce3a3 on hv-cinder-82282 Sep 19 11:52:17.117515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-624147cd-deb8-46b4-be99-74b52c859bb9 req-a3ef6332-fc28-461f-9924-7b2cbe84e25e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106952 Sep 19 11:52:17.118115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1460/2946] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 11:52:17.133515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:17.142501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ca83ad04-355e-4aaa-a616-eedf9ccebf08 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.188397 Sep 19 11:52:17.143090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1487/2947] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:16 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:17.440040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:17.440711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:17.446850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:17.447386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:17.447830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:17.448515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:17.448975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:17.449396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:17.578777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:17.587054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:17.595376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:17.595376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-937a7d42-8497-48ed-b3be-8eee178c4274 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154928 Sep 19 11:52:17.595376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1461/2948] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:17.977502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:17.978071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:17.984701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:17.985176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:17.985611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:17.986297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:17.986747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:17.987186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:18.052694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:18.061042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4cb2f17b-538a-48cd-bbe0-a407ce94d93e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087724 Sep 19 11:52:18.061775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1488/2949] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:18.166530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:18.167361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:18.174175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:18.174929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:18.175113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:18.175861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:18.176325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:18.176757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:18.316070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:18.324321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8a3f08ed-cfaf-4625-a9ac-57b079abcf9c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.162248 Sep 19 11:52:18.325068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1462/2950] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:18 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:18.615526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:18.616136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:18.622141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:18.622627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:18.623073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:18.624347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:18.624807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:18.625238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:18.752837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:18.761808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:18.763268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:18.765039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a422bc3-7c5b-49cd-bc27-035aa3da1569 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152973 Sep 19 11:52:18.765600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1489/2951] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:19.084277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:19.084908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:19.090841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:19.091366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:19.091802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:19.092515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:19.092966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:19.093416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:19.156572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:19.165023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d64068e3-dc27-4285-97ad-7cade8488a01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084358 Sep 19 11:52:19.165593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1463/2952] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:19.348856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:19.349406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:19.355751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:19.356230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:19.356721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:19.357371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:19.357820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:19.358922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:19.485232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:19.493384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0109cd59-44ea-40f5-bc76-dc4cf0b48722 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148485 Sep 19 11:52:19.493952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1490/2953] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:19 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:19.790891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:19.791554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:19.798095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:19.798576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:19.799014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:19.799736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:19.800194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:19.800623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:19.933700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:19.942219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:19.943817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:19.945038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8400fa8c-b2f1-45c4-bd99-6ffc4cce3b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158401 Sep 19 11:52:19.945834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1464/2954] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:20.189388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:20.189999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:20.195984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:20.196465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:20.196906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:20.197589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:20.198044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:20.198472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:20.262800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:20.271720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6c0d7a1c-7e7e-4bcd-83b0-a81ff5e9f6e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086830 Sep 19 11:52:20.272284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1491/2955] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:20.516178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:20.516702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:20.522650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:20.523129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:20.523592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:20.524268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:20.524717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:20.525139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:20.652928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:20.661624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0b57576d-921d-4842-9a10-d4afb03e3f10 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149419 Sep 19 11:52:20.662196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1465/2956] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:20 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:20.971850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:20.972454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:20.978967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:20.979487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:20.979928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:20.980664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:20.981118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:20.981557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:21.114935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:21.124316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:21.125736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:21.126894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aae312a4-0cde-4cf0-9cad-95819c1f1430 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159086 Sep 19 11:52:21.127477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1492/2957] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:21.296456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:21.297187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:21.303601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:21.304136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:21.304558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:21.305279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:21.305735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:21.306154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:21.370897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:21.379779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-34d161fe-2082-42b0-9121-4c8c498653f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088257 Sep 19 11:52:21.380343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1466/2958] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:21.685191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:21.685757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:21.695045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:21.695596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:21.696116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:21.696747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:21.697210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:21.697648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:21.832389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:21.840632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-988da4d3-f590-4247-a0e0-ca66f3c5bc60 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159580 Sep 19 11:52:21.841204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1493/2959] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:21 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:22.152723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:22.153250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:22.159427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:22.159919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:22.160364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:22.161054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:22.161514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:22.161948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:22.287218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:22.296654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:22.298106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:22.299297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d7c7e72-c1eb-4790-be6b-cecc6c365555 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.150694 Sep 19 11:52:22.299856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1467/2960] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:22.401991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:22.402537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:22.409014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:22.409491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:22.409925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:22.410604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:22.411053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:22.411543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:22.475333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:22.483658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e04e7457-b573-44eb-b619-48836fbb4746 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085595 Sep 19 11:52:22.484513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1494/2961] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:22.865076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:22.865690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:22.871682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:22.872166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:22.872609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:22.873293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:22.874411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:22.874843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:23.002136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:23.010525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1f1575e6-6350-43c2-9ca4-0a3f7b1e1233 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149313 Sep 19 11:52:23.011104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1468/2962] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:22 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:23.324787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:23.325425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:23.331890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:23.332379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:23.332821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:23.333504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:23.333962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:23.334395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:23.465558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:23.474921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:23.476390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:23.477546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c5ee6fbf-4707-4bbc-980e-5212c2d8a5ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156679 Sep 19 11:52:23.478105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1495/2963] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:23.507517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:23.508135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:23.515131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:23.515649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:23.516094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:23.516784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:23.517251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:23.517681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:23.580600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:23.588820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1f99d9e2-9fc0-46e6-923e-2c732c9a1a50 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085164 Sep 19 11:52:23.589394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1469/2964] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:24.033456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:24.034066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:24.040341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:24.040830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:24.041262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:24.041941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:24.042425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:24.042870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:24.171896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:24.180066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-77e3fa2a-eae5-44cd-89c1-1e4b62dca7e4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150531 Sep 19 11:52:24.180643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1496/2965] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:24 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:24.503649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:24.504267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:24.510265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:24.510851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:24.511232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:24.511929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:24.512394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:24.512827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:24.612427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:24.613031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:24.619406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:24.619888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:24.620327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:24.621015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:24.621465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:24.621883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:24.641384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:24.650055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:24.651537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:24.652711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-871478db-ec99-461f-b792-d97e96504c69 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152985 Sep 19 11:52:24.653275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1470/2966] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:24.685171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:24.693906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f3ef1372-5a55-4fc2-b940-fc5821b96db2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085392 Sep 19 11:52:24.694468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1497/2967] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:25.204266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:25.204865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:25.210772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:25.211289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:25.211729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:25.212405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:25.212856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:25.213273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:25.340406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:25.349152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c13218de-da84-48d2-bb42-56ae46f3bfc0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148770 Sep 19 11:52:25.349721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1471/2968] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:25 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:25.678363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:25.678975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:25.685609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:25.686711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:25.687151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:25.687872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:25.688330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:25.688759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:25.717656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:25.718253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:25.725209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:25.725726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:25.726152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:25.726859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:25.727846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:25.727846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:25.829153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:25.832692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:25.837989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b56a6ac9-45ba-41fe-9e47-ea76292c5cb4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.124345 Sep 19 11:52:25.838880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1472/2969] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:25.898164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:25.907435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:25.908914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:25.910087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9707166-8646-4ecd-ae1a-9555e6e6043f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.235702 Sep 19 11:52:25.910842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1498/2970] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:26.372625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:26.373040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:26.380398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:26.380887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:26.381328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:26.382235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:26.382572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:26.383076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:26.590518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:26.598831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-349c97de-a8df-476f-9de1-e8b025831086 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.230304 Sep 19 11:52:26.599442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1473/2971] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:26 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:26.862502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:26.863131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:26.869568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:26.870049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:26.870477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:26.871151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:26.871623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:26.872049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:26.937928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:26.938146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:26.938853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:26.945268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:26.945754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:26.946260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-77006774-3948-427b-a116-c1465161e5f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088242 Sep 19 11:52:26.946394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:26.947047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1499/2972] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:26.947208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:26.947478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:26.947910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:27.083340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:27.092117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:27.093619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:27.095114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-16d9b0bd-6858-4af6-ae3b-0e7d989c3cf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.161600 Sep 19 11:52:27.096130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1474/2973] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:52:27.622231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:27.622840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:27.629038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:27.629530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:27.629974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:27.630674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:27.631136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:27.631612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:27.635740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:27.758102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:27.766985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9641f305-5b86-464f-a684-2364fcdb375b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148583 Sep 19 11:52:27.767605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1500/2974] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:27 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:27.970597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:27.971158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:27.977765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:27.978237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:27.978668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:27.979388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:27.979837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:27.980253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:28.044461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:28.053275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0cc4e5f8-cb08-4d2d-90d5-234b54356929 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086614 Sep 19 11:52:28.053838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1475/2975] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:28.122523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:28.123129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:28.130759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:28.133684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:28.133684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:28.133684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:28.133684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:28.134128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:28.263529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:28.272218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:28.273664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:28.274829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f5af118d-4514-41d8-bfd2-69c03a2054d4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156341 Sep 19 11:52:28.275423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1501/2976] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:28.791408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:28.792136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:28.798640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:28.799125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:28.799597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:28.800280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:28.800734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:28.801158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:28.929266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:28.937491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e236f43-483c-4b8f-b65c-f94d44cbc727 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150362 Sep 19 11:52:28.938072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1476/2977] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:28 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:29.077077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:29.077611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:29.083496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:29.083972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:29.084406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:29.085164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:29.085615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:29.086038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:29.153648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:29.162491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8b8b38c2-c727-40ca-80a5-dbed590a44e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089433 Sep 19 11:52:29.163050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1502/2978] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:29.300992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:29.301602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:29.308076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:29.308561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:29.309001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:29.309701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:29.310155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:29.310584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:29.441449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:29.450052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:29.452016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:29.453171 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-db55d0be-3dec-402e-a268-3bcb0e3379f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156082 Sep 19 11:52:29.453734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1477/2979] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:29.961003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:29.961625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:29.968003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:29.968487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:29.968930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:29.969620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:29.970082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:29.970514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:30.098363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:30.106588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fd93b2e9-a48d-4af6-8804-a89320dbf1c5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149581 Sep 19 11:52:30.107161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1503/2980] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:29 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:30.186802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:30.187445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:30.193459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:30.193948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:30.194389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:30.195076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:30.195562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:30.195992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:30.258327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:30.266563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a2afe376-1039-4552-8c9e-0938d7209de3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084179 Sep 19 11:52:30.267124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1478/2981] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:30.479319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:30.479889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:30.486740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:30.487239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:30.487675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:30.488379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:30.488825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:30.489243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:30.617362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:30.626162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:30.627632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:30.628803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6efc7a0e-4a9b-430a-b270-b1147ba7c0db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153527 Sep 19 11:52:30.629367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1504/2982] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:31.130947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:31.131587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:31.137473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:31.137956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:31.138392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:31.139474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:31.139937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:31.140991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:31.283001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:31.288670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:31.289589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:31.292595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-651e528b-de70-402f-82db-1697ed2b62c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.165721 Sep 19 11:52:31.293116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1479/2983] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:31 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:31.296415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:31.296955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:31.297349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:31.298049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:31.298515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:31.298941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:31.365707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:31.374333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-41d56cd7-41f4-4a11-ad70-5016521e12ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089393 Sep 19 11:52:31.374870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1505/2984] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:31.653901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:31.654424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:31.660602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:31.661078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:31.661791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:31.662483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:31.662933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:31.663385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:31.795618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:31.805092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:31.806558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:31.807790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-42fc9b5b-5201-46d7-b85b-c59ab51d291e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157951 Sep 19 11:52:31.808344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1480/2985] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:32.316372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:32.316989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:32.323463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:32.323948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:32.324390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:32.325077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:32.325532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:32.325962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:32.401856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:32.402463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:32.409731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:32.410226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:32.410669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:32.411409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:32.411872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:32.412303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:32.464881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:32.473906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4a495e0e-b233-440e-8f91-575a2bbf4349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.161463 Sep 19 11:52:32.474484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1506/2986] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:32 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:32.484519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:32.492815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e6971f11-1a44-43dc-a8b4-2250d708fe4b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.094833 Sep 19 11:52:32.493381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1481/2987] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:32.834028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:32.834633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:32.840644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:32.846116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:32.846116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:32.846116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:32.846116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:32.846498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:32.969865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:32.978490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:32.979968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:32.981135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0fc28817-7b12-4f04-a925-552610297c05 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.151081 Sep 19 11:52:32.981694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1507/2988] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:33.497290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:33.497859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:33.504259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:33.504739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:33.505172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:33.505856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:33.506305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:33.506730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:33.516125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:33.516747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:33.523187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:33.523688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:33.524131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:33.524827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:33.525286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:33.525720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:33.606504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:33.614868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70e250d4-c42b-459c-b32d-7511a2098aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.103122 Sep 19 11:52:33.615480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1508/2989] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:33.663246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:33.672322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff8af72c-0ef9-44c0-ab88-b83fb40f0821 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.178974 Sep 19 11:52:33.673145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1482/2990] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:33 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:34.007141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:34.007936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:34.015301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:34.015843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:34.016307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:34.016985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:34.017440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:34.017873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:34.149837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:34.158520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:34.159979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:34.161128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1ba148d8-676c-46f2-8a35-7219f78e31d5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158328 Sep 19 11:52:34.161684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1509/2991] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:34.638333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:34.638950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:34.645476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:34.645963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:34.646400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:34.647091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:34.647574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:34.648006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:34.695895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:34.696545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:34.703215 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:34.703709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:34.704146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:34.704842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:34.705298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:34.705725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:34.709878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:34.718389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2c174e21-35db-44a0-bc97-84485e8d5420 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083954 Sep 19 11:52:34.718983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1483/2992] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:34.837447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:34.845507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-20b3b759-c4cc-429a-8481-cf060479953e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153539 Sep 19 11:52:34.846068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1510/2993] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:34 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:35.188326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:35.189382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:35.196104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:35.196624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:35.197061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:35.197748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:35.198197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:35.198621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:35.327858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:35.336584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:35.338020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:35.339249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8cadd556-2d29-49a6-be63-a053e9aab9ee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155545 Sep 19 11:52:35.339807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1484/2994] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:35.742075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:35.742675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:35.749280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:35.749765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:35.750207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:35.750892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:35.751408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:35.751840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:35.811859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:35.820059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c2d738d0-e42c-4a0f-97b4-a22fa734a97a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.081981 Sep 19 11:52:35.820623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1511/2995] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:35.868980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:35.869593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:35.876027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:35.876513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:35.876951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:35.877642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:35.878107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:35.878537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:36.008865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:36.017757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b98825f1-5f3b-4d67-a120-81a7d1f09c04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152747 Sep 19 11:52:36.018333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1485/2996] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:35 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:36.366108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:36.366655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:36.372658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:36.373648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:36.374087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:36.374769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:36.375264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:36.375697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:36.503480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:36.512069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:36.514110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:36.515308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e82bd6f8-8d63-4680-a537-96aad132922f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153285 Sep 19 11:52:36.515873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1512/2997] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:36.843995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:36.844608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:36.850550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:36.851039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:36.851522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:36.852212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:36.852673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:36.853104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:36.917778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:36.926794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a5f1e7b4-585f-441b-9c1d-325aca1e0fe0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086685 Sep 19 11:52:36.927395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1486/2998] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:37.042241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:37.042865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:37.049853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:37.050382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:37.050822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:37.051551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:37.052013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:37.052446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:37.185883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:37.194092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-66dcf073-9498-4aba-b88e-3e04e75cefcd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156046 Sep 19 11:52:37.194689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1513/2999] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:37 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:37.541299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:37.541931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:37.547943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:37.548424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:37.548858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:37.549562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:37.550011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:37.550436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:37.681008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:37.690036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:37.691508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:37.692681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-46caa3d0-7201-40f5-a197-7095df16cef7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155566 Sep 19 11:52:37.693245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1487/3000] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:37.950275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:37.950811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:37.956986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:37.957498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:37.957941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:37.958637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:37.959098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:37.959976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:38.024655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:38.033586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fc068cbc-89ee-4e7c-bda7-fc1ca8a4ffb0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087417 Sep 19 11:52:38.034163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1514/3001] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:38.217900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:38.218522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:38.225046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:38.225538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:38.225980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:38.226679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:38.227138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:38.227594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:38.358442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:38.366707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c5938c5f-f47c-4b15-90a9-06ad99d75900 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153466 Sep 19 11:52:38.367290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1488/3002] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:38 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:38.719106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:38.719734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:38.726404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:38.726891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:38.727367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:38.728076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:38.728532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:38.728967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:38.861760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:38.870251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:38.871775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:38.873466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8c0c55f1-c494-4066-bf01-aa71fc7a8bd0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158023 Sep 19 11:52:38.874013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1515/3003] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:39.057870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:39.058481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:39.065125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:39.065602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:39.066035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:39.066713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:39.067161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:39.067624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:39.085233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:39.131854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:39.140079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-45be4230-4db9-4fdb-ab77-872c16abf241 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086040 Sep 19 11:52:39.140655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1489/3004] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:39.389026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:39.389564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:39.395694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:39.396184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:39.396625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:39.397353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:39.397812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:39.398244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:39.529990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:39.533775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:39.539566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c8926dfa-ec7b-4a87-b59c-bf76a7d55069 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154058 Sep 19 11:52:39.540176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1516/3005] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:39 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:39.899426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:39.900036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:39.906780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:39.907354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:39.907810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:39.908546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:39.909014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:39.909453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:40.036778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:40.046274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:40.047798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:40.048960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-719599d2-ab25-44ff-a19d-034b474f1a76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153495 Sep 19 11:52:40.049522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1490/3006] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:40.163235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:40.163848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:40.171508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:40.172038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:40.172438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:40.173129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:40.173587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:40.174017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:40.237039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:40.245303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2a44a1ab-dc4a-4f08-a270-b93799c93359 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085900 Sep 19 11:52:40.245808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1517/3007] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:40.563793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:40.564405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:40.570408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:40.570884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:40.571351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:40.572031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:40.572483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:40.572922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:40.704525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:40.712769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-835d95d3-63ea-4bbf-a8ba-1a58d5a6c45a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153467 Sep 19 11:52:40.713341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1491/3008] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:40 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:41.075052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:41.075690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:41.081973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:41.082464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:41.082909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:41.083649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:41.084092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:41.084524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:41.216895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:41.225682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:41.227104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:41.228286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-31c15363-9b78-4a32-9804-5c8600317ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157252 Sep 19 11:52:41.228835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1518/3009] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:41.268818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:41.269438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:41.275886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:41.276384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:41.276819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:41.277507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:41.277969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:41.278395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:41.347000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:41.355246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2bae580e-bd02-42ac-9bc0-cfcdfbe707f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090280 Sep 19 11:52:41.355817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1492/3010] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:41.735600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:41.736151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:41.742253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:41.742772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:41.743234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:41.743928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:41.744381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:41.744807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:41.872127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:41.880793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb26cb27-904a-4cee-9180-913469c368d2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149228 Sep 19 11:52:41.881359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1519/3011] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:41 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:42.254977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:42.255629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:42.261682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:42.262194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:42.262633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:42.263430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:42.263896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:42.264325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:42.379202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:42.379754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:42.386107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:42.386592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:42.387024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:42.388138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:42.394611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:42.394611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:42.395471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:42.400778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:42.402232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:42.403435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-66a9b601-3e78-4cb6-a337-eeb25574e787 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152462 Sep 19 11:52:42.404518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1493/3012] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:42.453145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:42.461577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fb264f61-4470-4e62-ac45-f86f382e7a86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086384 Sep 19 11:52:42.462159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1520/3013] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:42.903568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:42.904754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:42.910773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:42.911290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:42.911737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:42.912428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:42.912892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:42.913324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:43.042210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:43.050420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-20aba303-5199-4568-a120-c65148c926b3 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150812 Sep 19 11:52:43.050981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1494/3014] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:42 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:43.429852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:43.430469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:43.437714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:43.438181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:43.438614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:43.439322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:43.439771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:43.440190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:43.484638 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:43.485258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:43.492105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:43.492528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:43.493074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:43.493667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:43.494130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:43.494561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:43.574023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:43.582854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6ba54308-7736-4646-b33f-fae30dbdce07 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.102048 Sep 19 11:52:43.583470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1495/3015] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:43.597099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:43.605957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:43.607626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:43.608793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ecaa84d8-a845-4b90-adbf-13ee6f73373a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.182855 Sep 19 11:52:43.609364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1521/3016] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:44.073774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:44.074377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:44.080962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:44.081447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:44.081878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:44.082552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:44.083005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:44.083452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:44.212209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:44.220887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ed45be25-cc90-4c7a-b963-a748588c6608 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151267 Sep 19 11:52:44.221469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1496/3017] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:44 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:44.607478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:44.608094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:44.614540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:44.615027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:44.615510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:44.616205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:44.616660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:44.617093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:44.633830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:44.634522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:44.640941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:44.641416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:44.641850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:44.642537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:44.643063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:44.643450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:44.679300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:44.687640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7854d47a-bc1a-4165-a78b-5aad258a6edb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084812 Sep 19 11:52:44.688227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1522/3018] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:44.776008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:44.785041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:44.786452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:44.787635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4bbc657f-abaa-47fd-907a-ba9f6a417ef4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157693 Sep 19 11:52:44.788189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1497/3019] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:52:45.244012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:45.244683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:45.250756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:45.251266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:45.251710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:45.252397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:45.252863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:45.253291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:45.390046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:45.398674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ab18cdd7-e2ea-4609-9989-27e7c393f2e7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.158492 Sep 19 11:52:45.399295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1523/3020] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:45 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:45.710555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:45.711095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:45.718292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:45.718834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:45.719307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:45.720004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:45.720463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:45.720900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:45.780992 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:45.789493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-773df7f4-2c1e-4b65-9935-eaf5833d74ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082857 Sep 19 11:52:45.790067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1498/3021] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:45.815915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:45.816555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:45.822978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:45.823498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:45.823940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:45.824627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:45.825081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:45.825506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:45.957346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:45.966041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:45.967435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:45.968580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-03700318-e84a-4022-aead-a89122774322 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156756 Sep 19 11:52:45.969136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1524/3022] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:46.422998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:46.423942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:46.429953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:46.430436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:46.430878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:46.431618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:46.432075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:46.432505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:46.559677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:46.568524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ba35e55e-53f0-4596-9fa9-b5e5c469d679 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150062 Sep 19 11:52:46.569100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1499/3023] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:46 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:46.813412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:46.814027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:46.820668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:46.821283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:46.821580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:46.822310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:46.822767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:46.823227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:46.883782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:46.891932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e087c547-6348-40c1-b695-b70026f333db tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083067 Sep 19 11:52:46.892498 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1525/3024] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:46.994545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:46.995187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:46.997059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=82 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:47.002059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:47.002552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:47.002994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:47.003790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:47.004255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:47.004683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:47.137637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:47.146414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:47.147909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:47.149068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d9b543dd-4a73-495e-9176-b6a5573091a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158472 Sep 19 11:52:47.149630 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1500/3025] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:47.601857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:47.602464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:47.604337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=78 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:47.610912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:47.611425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:47.611869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:47.612559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:47.613011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:47.613452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:47.747648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:47.756022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3c573ab7-bb0a-4702-9f80-a8d79e8b531a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.158191 Sep 19 11:52:47.756593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1526/3026] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:47 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:47.925086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:47.925591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:47.932073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:47.932550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:47.932982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:47.933663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:47.934115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:47.934539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:47.995027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:48.003332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e04f3e23-273f-485d-86cc-3f9a4b19415e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082183 Sep 19 11:52:48.003897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1501/3027] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:48.175961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:48.176728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:48.182645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:48.183125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:48.183591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:48.184278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:48.184736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:48.185168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:48.315997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:48.324618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:48.326709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:48.327888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-69def8ae-c299-4c59-a57f-64a6a75bfd2b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155996 Sep 19 11:52:48.328446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1527/3028] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:48.779063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:48.779698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:48.785740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:48.786218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:48.786647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:48.787366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:48.787816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:48.788241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:48.915226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:48.923920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8a5077e5-418f-4e9b-baf7-d586186c7b62 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148768 Sep 19 11:52:48.924484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1502/3029] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:48 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:49.025991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:49.026636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:49.033310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:49.033738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:49.034184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:49.034873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:49.035379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:49.035810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:49.099223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:49.108139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-02457638-ebb5-435a-a1f9-421fd33fe753 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086028 Sep 19 11:52:49.108713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1528/3030] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:49 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:49.354350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:49.354921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:49.364302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:49.364796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:49.365236 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:49.365954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:49.366409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:49.366844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:49.494893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:49.503520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:49.504947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:49.506101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dafcb547-f181-403d-a361-a83a47499c73 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155977 Sep 19 11:52:49.506647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1503/3031] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:49.948047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:49.948687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:49.955287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:49.955774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:49.956214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:49.956898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:49.957351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:49.957781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:50.086697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:50.094952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb355bb5-8359-4ccf-9ee4-089cbdd3edc6 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151365 Sep 19 11:52:50.095551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1529/3032] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:49 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:50.133254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:50.133865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:50.140391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:50.140873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:50.141307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:50.141993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:50.142437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:50.142859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:50.205915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:50.214151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4db0e8c5-9ff0-4b1f-a13e-124201672e94 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084713 Sep 19 11:52:50.214720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1504/3033] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:50.532042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:50.532642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:50.538799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:50.539325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:50.539758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:50.540433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:50.540879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:50.541302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:50.667995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:50.676554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:50.677979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:50.679152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ba635f21-8489-46eb-9c2c-a9d237528536 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.151057 Sep 19 11:52:50.679730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1530/3034] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:50 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:51.118062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:51.118684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:51.126043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:51.126529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:51.126963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:51.127692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:51.128151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:51.128574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:51.237174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:51.237856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:51.244434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:51.244910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:51.245339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:51.246026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:51.246480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:51.246902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:51.260512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:51.269323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-90dec7f2-df4e-4425-99b4-9e1750ea7bba tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155204 Sep 19 11:52:51.270108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1505/3035] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:51 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:51.312952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:51.321373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fa56f73c-9bb3-460f-8514-93151dc34d4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088045 Sep 19 11:52:51.321954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1531/3036] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:51.706160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:51.706820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:51.713563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:51.714115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:51.714559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:51.715316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:51.715812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:51.716244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:51.720957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:51.850562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:51.860761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:51.862223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:51.863455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ae329253-0816-453b-8193-15f1f7f90375 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.161376 Sep 19 11:52:51.864023 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1506/3037] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:52:52.294499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:52.295094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:52.301787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:52.302273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:52.302705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:52.303425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:52.303878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:52.304299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:52.345580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:52.346287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:52.354002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:52.354529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:52.354959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:52.360132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:52.360614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:52.361056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:52.453030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:52.461179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3ae3d322-5e93-46ab-bd73-1e22fb9aa0fc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.119694 Sep 19 11:52:52.461753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1507/3038] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:52.479495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:52.488268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e514a41-d866-4df5-a9d1-f3b985621fb5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.197688 Sep 19 11:52:52.488847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1532/3039] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:52 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:52.888789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:52.889398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:52.895373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:52.895864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:52.896300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:52.896985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:52.897441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:52.897874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:53.026914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:53.035982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:53.037424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:53.038897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a435efc2-1462-41eb-ba5c-f020fba1e30e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153877 Sep 19 11:52:53.039506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1508/3040] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:52:53.484410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:53.485156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:53.491892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:53.492369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:53.492813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:53.493510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:53.493972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:53.494399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:53.511950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:53.512567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:53.513238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:52:53.519525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:53.526692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:53.526692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:53.526692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:53.526692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:53.527316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:53.557637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:53.566160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9906d6c-a69b-4dd5-9ebb-09c1282c019f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085658 Sep 19 11:52:53.566744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1533/3041] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:53.654754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:53.663059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fcb60d7e-de00-42aa-be9e-b7d87e5e531c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154974 Sep 19 11:52:53.663918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1509/3042] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:53 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:52:54.065016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:54.065630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:54.071610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:54.072096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:54.072538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:54.073223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:54.073680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:54.074113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:54.203090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:54.212059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:54.213502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:54.214676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c7b96809-0699-47bc-b59f-e46363c87d04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153783 Sep 19 11:52:54.215265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1534/3043] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:54.589756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:54.590371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:54.597338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:54.597824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:54.598259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:54.598942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:54.599430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:54.599856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:54.660123 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:54.668632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0d1b8620-5966-4b40-9d7e-39ebc08d8564 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082762 Sep 19 11:52:54.669759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1510/3044] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:54.685782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:54.686417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:54.693108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:54.693601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:54.694048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:54.694751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:54.695231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:54.695743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:54.828340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:54.836478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-14c133ec-1f59-4b18-ab0f-bf87597b59e5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154627 Sep 19 11:52:54.837037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1535/3045] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:54 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:55.241192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:55.241824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:55.247765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:55.248237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:55.248679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:55.249349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:55.249796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:55.250217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:55.378381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:55.393496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:55.395062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:55.396372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e0c04088-ba5b-4d16-ac80-f58088bcee99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159076 Sep 19 11:52:55.396938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1511/3046] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:55.692519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:55.693365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:55.700066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:55.701083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:55.701517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:55.702205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:55.702655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:55.703080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:55.763815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:55.771978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cfc3a1b8-af15-4447-9b76-0d30e2decea0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083390 Sep 19 11:52:55.772535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1536/3047] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:55.860452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:55.861053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:55.867524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:55.868010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:55.868448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:55.869136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:55.869588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:55.870014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:56.000148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:56.008794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1e38fa86-cec0-4775-b940-7a06dd30453c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152256 Sep 19 11:52:56.009375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1512/3048] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:55 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:56.423345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:56.423953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:56.429925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:56.430414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:56.430852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:56.431575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:56.432035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:56.432463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:56.559224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:56.568475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:56.569915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:56.571071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5a47cc9c-ba2d-485b-b02b-740cafbbe135 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152232 Sep 19 11:52:56.571661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1537/3049] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:56.796225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:56.796875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:56.802886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:56.803404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:56.803842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:56.804519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:56.804972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:56.805587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:56.870280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:56.878463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-341aae47-c45f-41f9-a974-a580c65e9f0d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086848 Sep 19 11:52:56.879029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1513/3050] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:57.033084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:57.033698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:57.040374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:57.040857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:57.041321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:57.042013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:57.042469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:57.042894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:57.172934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:57.181241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-84150d09-313b-4a44-95f3-f2f2c4b04e8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152697 Sep 19 11:52:57.181811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1538/3051] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:57 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:57.596536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:57.597175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:57.603106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:57.603609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:57.604042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:57.604717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:57.605167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:57.605586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:57.737088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:57.745822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:57.747356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:57.748592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eaddec5a-bb0f-4b1d-a679-71ba5b4e4795 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155934 Sep 19 11:52:57.749117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1514/3052] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:57.901833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:57.902364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:57.909190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:57.909678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:57.910119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:57.910817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:57.911314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:57.911745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:57.975022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:57.983966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-05ac959c-dd31-4e48-ab5d-a809bd58349c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086058 Sep 19 11:52:57.984557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1539/3053] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:58.205919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:58.206483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:58.212949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:58.218655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:58.218655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:58.218655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:58.218655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:58.219084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:58.344597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:58.352837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-88854173-64c7-4b4e-9802-8e3074dd4377 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151079 Sep 19 11:52:58.353418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1515/3054] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:58 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:58.774708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:58.775348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:58.782416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:58.783013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:58.783596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:58.784406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:58.784971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:58.785510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:58.912815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:58.922376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:58.923866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:58.925035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2a5238a3-fc58-48ce-af71-9bcc2359a2b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154320 Sep 19 11:52:58.925594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1540/3055] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:52:59.007258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:59.007872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:59.014195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:59.014678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:59.015111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:59.015814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:59.016266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:59.016689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:59.080028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:59.088109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8b7a64e1-67ce-4373-98d2-3500ffba6016 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084970 Sep 19 11:52:59.088675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1516/3056] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:59 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:59.375898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:59.376546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:59.382647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:59.384841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:59.384841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:59.384841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:59.384841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:59.385260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:59.522625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:52:59.531440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-07ea79d2-69b6-4981-a006-e58c97c3957e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159389 Sep 19 11:52:59.532002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1541/3057] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:52:59 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:52:59.950668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:52:59.951317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:52:59.957725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:59.958211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:59.958647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:52:59.959370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:52:59.959829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:52:59.960253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:00.087370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:00.096522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:00.097998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:00.099195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-85e2df87-0eb2-4ca9-84db-9a065e75b914 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152412 Sep 19 11:53:00.099752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1517/3058] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:52:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:00.111439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:00.112216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:00.119565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:00.120125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:00.120919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:00.121347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:00.121809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:00.122227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:00.187983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:00.196180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad00b367-9c6d-4a2d-b375-6d004ab38b5a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088669 Sep 19 11:53:00.196745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1542/3059] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:00.554751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:00.555392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:00.561921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:00.562413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:00.562851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:00.563568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:00.564027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:00.564455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:00.691251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:00.699346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-45d622a4-9f1f-44b3-b8f1-94923670c8ee tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148499 Sep 19 11:53:00.699904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1518/3060] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:00 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:01.129490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:01.130150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:01.136608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:01.137084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:01.137517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:01.138197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:01.138644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:01.139065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:01.221646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:01.222255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:01.229010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:01.229773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:01.230827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:01.232488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:01.232710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:01.233028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:01.272204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:01.281816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:01.283280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:01.284445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-688eb9ef-ae87-4347-b68f-cc889c759d6c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159156 Sep 19 11:53:01.285763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1543/3061] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:01.311851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:01.320139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7a90c7c4-8cc5-4964-9ab3-b6b124bbbb67 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.102658 Sep 19 11:53:01.320696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1519/3062] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:01.723730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:01.724255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:01.731026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:01.731575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:01.732015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:01.732739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:01.733198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:01.733625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:01.863333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:01.871648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5bffdebf-8acc-4714-bf82-b1042ffc4ccd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152295 Sep 19 11:53:01.872712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1544/3063] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:01 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:02.310830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:02.311469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:02.317834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:02.318313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:02.318771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:02.319482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:02.319934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:02.320355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:02.343960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:02.344603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:02.351057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:02.351580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:02.352016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:02.352722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:02.353393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:02.353715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:02.442292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:02.457087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad252bb6-8d34-45ef-968a-fac6672a9eed tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.117214 Sep 19 11:53:02.458168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1545/3064] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:02.498509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:02.508262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:02.509803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:02.510976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c0c7a8bc-9a7d-4c0f-a3ac-a7d333fa74c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.204044 Sep 19 11:53:02.511670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1520/3065] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:02.895258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:02.895978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:02.902007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:02.902501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:02.902943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:02.903793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:02.904254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:02.904691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:03.030283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:03.038872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-41fd2bc0-db87-4a71-840e-b6900326b56b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.147492 Sep 19 11:53:03.039519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1546/3066] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:02 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:03.491088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:03.491722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:03.498301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:03.498794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:03.499445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:03.500644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:03.501195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:03.501940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:03.537965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:03.538879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:03.546145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:03.546635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:03.547080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:03.547813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:03.548269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:03.548726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:03.565990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:03.574292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-08d7e14a-2551-4830-a3f5-bab8f08cef95 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087075 Sep 19 11:53:03.574867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1521/3067] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:03.678971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:03.687847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:03.695427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:03.695427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-59a37b70-5568-4242-869b-e79be5fe293c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156414 Sep 19 11:53:03.695427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1547/3068] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:53:04.063756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:04.064286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:04.070503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:04.070993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:04.071459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:04.072163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:04.072621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:04.073055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:04.204833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:04.208409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:04.213546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-976f7bd8-b8f6-471a-a4a1-9249ac6d5268 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154335 Sep 19 11:53:04.214138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1522/3069] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:04 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:04.597681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:04.598282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:04.604739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:04.605221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:04.605663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:04.606353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:04.606807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:04.607266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:04.667228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:04.675465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b50d3a70-5f4f-4b7f-b571-950d3012d0a3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.081601 Sep 19 11:53:04.676029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1548/3070] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:04.719937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:04.720543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:04.728142 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:04.728635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:04.729078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:04.729803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:04.730263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:04.730716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:04.859352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:04.867946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:04.869367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:04.870515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b145c0f7-6f9c-4235-a68e-f1df02062c26 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155066 Sep 19 11:53:04.871286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1523/3071] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:05.237768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:05.238381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:05.244504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:05.244995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:05.245436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:05.246125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:05.246621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:05.247051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:05.372555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:05.380806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-052466d7-9f80-4346-921e-544eb4d62089 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.146881 Sep 19 11:53:05.381372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1549/3072] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:05 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:05.698467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:05.699032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:05.705743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:05.706229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:05.706672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:05.707392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:05.707846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:05.708273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:05.769912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:05.778263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c4455867-5ce3-4561-a5d1-1f0969bf8493 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083728 Sep 19 11:53:05.778834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1524/3073] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:05.896135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:05.896773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:05.903314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:05.903800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:05.904279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:05.904977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:05.905431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:05.905861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:05.909837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:06.037828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:06.047558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:06.049015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:06.050185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-046d5d6a-8a29-4fab-b511-5abb4bf29935 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157998 Sep 19 11:53:06.050750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1550/3074] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:06.405059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:06.405649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:06.411672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:06.412155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:06.412616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:06.413570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:06.414026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:06.414452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:06.546039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:06.554267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5d145ca2-16ec-4aa6-8e0f-cef8c6852e16 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153631 Sep 19 11:53:06.554847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1525/3075] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:06 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:06.801938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:06.802591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:06.808808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:06.809327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:06.809770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:06.810473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:06.810936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:06.811477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:06.877205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:06.885584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ac94d49e-45d3-4a78-9ca7-79ba850024ce tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087707 Sep 19 11:53:06.886156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1551/3076] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:07.077166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:07.077731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:07.084366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:07.084842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:07.085275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:07.085996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:07.086442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:07.086861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:07.220185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:07.225951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:07.227428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:07.228587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-57f40ab2-2a8d-4824-af00-286858df58bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156043 Sep 19 11:53:07.229144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1526/3077] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:07.577946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:07.578548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:07.585000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:07.585479 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:07.585908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:07.586581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:07.587027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:07.587474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:07.717739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:07.726224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6c3919f6-4f39-4791-90f4-e299388dfe35 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152612 Sep 19 11:53:07.726827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1552/3078] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:07 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:07.909164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:07.909697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:07.916045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:07.916531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:07.916973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:07.917663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:07.918127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:07.918627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:07.982888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:07.991316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bd18e167-e29e-4d59-971d-49ff3e3dc62b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085987 Sep 19 11:53:07.991890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1527/3079] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:08.254224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:08.254834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:08.261520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:08.262012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:08.263119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:08.263869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:08.264328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:08.264760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:08.633174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:08.642270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:08.643789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:08.644995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-34a37665-d3da-403f-beda-569b942100bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.394785 Sep 19 11:53:08.645558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1553/3080] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:08.750547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:08.751160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:08.757606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:08.758078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:08.758507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:08.759209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:08.759662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:08.760083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:08.887799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:08.896093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2c899492-afb9-4c65-b281-ccceff6760f7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149457 Sep 19 11:53:08.896662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1528/3081] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:08 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:09.015467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:09.016074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:09.022025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:09.022508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:09.022946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:09.023659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:09.024117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:09.024543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:09.087593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:09.096358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-38f1e114-bf68-4189-bf25-92b7e00291fb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085405 Sep 19 11:53:09.096925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1554/3082] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:09.670854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:09.671519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:09.677651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:09.678136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:09.678571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:09.679394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:09.679855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:09.680279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:09.812581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:09.823059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:09.824618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:09.825892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cb3d7fd5-4983-42c8-8d27-ef82953c3b03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158900 Sep 19 11:53:09.826459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1529/3083] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:09.920637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:09.921419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:09.927887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:09.928371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:09.928813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:09.929502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:09.929958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:09.930386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:10.060747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:10.068984 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f48b3ba4-fff2-4dd7-afc7-fbd93ea5162a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152929 Sep 19 11:53:10.069549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1555/3084] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:09 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:10.119256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:10.119866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:10.126381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:10.126856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:10.127317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:10.128000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:10.128449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:10.128869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:10.189037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:10.197315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-39d6a120-0788-491d-8814-d2657d93416d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.081913 Sep 19 11:53:10.197883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1530/3085] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:10.851252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:10.851854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:10.858313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:10.858796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:10.859251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:10.859947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:10.860381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:10.860808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:10.989523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:10.998234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:10.999780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:11.000941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-00ce48fe-511e-45f8-914f-ba5b22c05a4b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153704 Sep 19 11:53:11.001504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1556/3086] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:10 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:53:11.091816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:11.092432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:11.098917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:11.099446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:11.099892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:11.100582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:11.101049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:11.101529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:11.220645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:11.221244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:11.227305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:11.227786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:11.228217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:11.228896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:11.229339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:11.229762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:11.234500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:11.242793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-395c01be-a9ae-45c8-8492-048ea2ae2426 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155428 Sep 19 11:53:11.243543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1531/3087] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:11 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:11.293214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:11.301426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-746d305b-db3b-49f9-b493-15b4eaa615a8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084662 Sep 19 11:53:11.302058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1557/3088] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:12.026043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:12.026660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:12.033346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:12.033837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:12.034281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:12.035068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:12.035562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:12.035995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:12.168902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:12.178122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:12.179624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:12.180834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-166bef20-d878-4e25-a7c1-4d804b00bf76 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158795 Sep 19 11:53:12.181438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1532/3089] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:12.266239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:12.266851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:12.273558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:12.274057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:12.274496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:12.275234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:12.275733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:12.276165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:12.325347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:12.326066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:12.332461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:12.332953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:12.333394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:12.334103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:12.334561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:12.334991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:12.424303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:12.432489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b04fc834-89af-40f3-870a-b1a4ace1a933 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.111627 Sep 19 11:53:12.433057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1533/3090] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:12.441082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:12.450196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d11c1a71-76d7-4a72-8283-73c8978d5146 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.188072 Sep 19 11:53:12.450761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1558/3091] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:12 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:13.206748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:13.207461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:13.213848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:13.214337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:13.214778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:13.215498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:13.215958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:13.216387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:13.346045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:13.354549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:13.356095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:13.357239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b4250887-b29c-49ac-853b-6b644d3223ff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154483 Sep 19 11:53:13.357790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1534/3092] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:13.456943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:13.457475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:13.463997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:13.464482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:13.464923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:13.465617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:13.466078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:13.466505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:13.473858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:13.474473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:13.480485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:13.480972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:13.481412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:13.482114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:13.482570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:13.482998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:13.532906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:13.541510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3bb332f1-29f8-4b54-8151-5a0a0ba1c817 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088523 Sep 19 11:53:13.542093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1559/3093] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:13.631294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:13.639722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1506312f-b9b2-457d-a48d-b46b0fb33b2f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.169811 Sep 19 11:53:13.640289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1535/3094] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:13 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:14.383491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:14.384054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:14.390250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:14.390744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:14.391218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:14.391930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:14.392394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:14.392832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:14.521026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:14.529604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:14.531059 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:14.532248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0ed45d39-4dd2-4fc3-8045-6f7fd5dfa228 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152849 Sep 19 11:53:14.532799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1560/3095] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:14.570507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:14.571133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:14.577741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:14.578219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:14.578670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:14.579389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:14.579852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:14.580285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:14.643356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:14.651468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-81760502-45e8-4e4a-aaaf-34f60d92c5b9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084960 Sep 19 11:53:14.652035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1536/3096] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:14.724270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:14.724880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:14.731796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:14.732265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:14.732702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:14.733377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:14.733825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:14.734250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:14.862004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:14.870243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6b91ae21-2dbb-4600-8ee4-5db5de745a4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.212391 Sep 19 11:53:14.870817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1561/3097] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:14 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:15.560987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:15.561622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:15.567710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:15.568223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:15.568651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:15.569335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:15.569784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:15.570203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:15.675712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:15.677114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:15.684926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:15.686124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:15.686124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:15.687198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:15.700848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:15.701354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:15.706564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:15.717175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:15.718766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:15.719840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a7a467ca-f337-4252-8cef-adea95218565 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.163526 Sep 19 11:53:15.720399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1537/3098] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:15.771436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:15.780224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5abadcf5-83bf-4a12-aa26-a711051f4d83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.108613 Sep 19 11:53:15.780815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1562/3099] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:15.894324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:15.894861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:15.900912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:15.901401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:15.901840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:15.902532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:15.902991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:15.903448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:16.031484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:16.039977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-58e3d200-4e67-4b28-bca4-e07d6c844366 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149610 Sep 19 11:53:16.040546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1538/3100] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:15 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:16.745843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:16.746463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:16.752858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:16.753337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:16.753773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:16.754451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:16.754901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:16.755373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:16.804686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:16.805280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:16.811574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:16.812058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:16.812502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:16.813317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:16.813768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:16.814193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:16.833395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:16.895340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:16.903643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-955bb1d8-a9f0-4511-98fd-b9cba04db013 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.102966 Sep 19 11:53:16.904215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1539/3101] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:16.922222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:16.930820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:16.932340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:16.933501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3afd2607-eed0-4cba-a2b9-6189f64874af tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.191709 Sep 19 11:53:16.934553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1563/3102] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:17.064657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:17.065268 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:17.067442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=80 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:17.072148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:17.072631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:17.073067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:17.077962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:17.077962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:17.077962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:17.209524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:17.217878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc422bf9-1432-49e1-b25a-05de166b815b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157281 Sep 19 11:53:17.218444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1540/3103] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:17 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:17.927393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:17.928010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:17.930034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=76 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:17.934802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:17.935326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:17.935768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:17.936458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:17.936913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:17.937341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:17.960308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:17.960927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:17.968209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:17.968695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:17.969132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:17.969850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:17.970300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:17.970722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:17.999589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:18.008688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3a0b3cd3-65fd-49c7-9bc8-eea825d3d10f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085194 Sep 19 11:53:18.009197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1564/3104] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:18.103767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:18.116824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:18.118266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:18.119496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e42ffb91-82af-4f23-bba5-b799c41b0cc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.163089 Sep 19 11:53:18.120069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1541/3105] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:53:18.241298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:18.241910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:18.248811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:18.249296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:18.249732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:18.250428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:18.250875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:18.251329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:18.385867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:18.395999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fc136d6b-687c-4b90-bffc-643c87e11a26 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.158657 Sep 19 11:53:18.396466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1565/3106] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:18 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:19.032293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:19.032988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:19.039780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:19.040269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:19.040712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:19.041400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:19.041856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:19.042281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:19.102645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:19.111605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1fcd591e-0eb8-42d5-9924-a9eb42251a88 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083078 Sep 19 11:53:19.112407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1542/3107] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:19.145502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:19.146109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:19.153283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:19.153764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:19.154239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:19.154913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:19.155413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:19.155833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:19.289081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:19.292496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:19.298727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:19.300206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:19.301377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-be3f0f27-f5c1-48aa-a0e4-5f07baba6cc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159788 Sep 19 11:53:19.301938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1566/3108] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:19.420245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:19.420856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:19.426779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:19.427308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:19.427750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:19.428437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:19.428898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:19.429325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:19.557761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:19.565806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b457563e-4f00-47fd-9a88-360d22677c27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150073 Sep 19 11:53:19.566365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1543/3109] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:19 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:20.135343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:20.135968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:20.142537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:20.143019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:20.143507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:20.144185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:20.144641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:20.145072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:20.205924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:20.214162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-605e0d45-4108-45bd-8ac7-5654068651f6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082745 Sep 19 11:53:20.215268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1567/3110] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:20.327593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:20.328193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:20.334674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:20.335150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:20.335614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:20.336291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:20.336742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:20.337162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:20.469506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:20.478080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:20.479560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:20.480767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-de6fc30e-e281-4dd6-a918-a56d1eb3b52d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157852 Sep 19 11:53:20.481338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1544/3111] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:20.589275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:20.590535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:20.596468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:20.596964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:20.597408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:20.598100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:20.598559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:20.598993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:20.724991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:20.733206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-648968d1-0d4e-4929-988f-6d849e416776 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.147832 Sep 19 11:53:20.733769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1568/3112] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:20 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:21.237574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:21.238197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:21.244207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:21.244693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:21.245133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:21.245821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:21.246906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:21.247366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:21.311744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:21.319924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-316fd937-22a9-443f-b08c-c26c86cb0c11 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086275 Sep 19 11:53:21.320497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1545/3113] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:21.506245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:21.506854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:21.513311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:21.513779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:21.514209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:21.514884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:21.515362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:21.515782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:21.642742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:21.651381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:21.654891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:21.654891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d19d36d-1a75-4088-92e4-3d849d12a681 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152181 Sep 19 11:53:21.655392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1569/3114] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:21.756807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:21.757368 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:21.764850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:21.765334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:21.765773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:21.766459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:21.766912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:21.767366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:21.895552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:21.907039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8e3a6e19-c64a-4aa7-8a5c-c6133e56dac2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154044 Sep 19 11:53:21.907650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1546/3115] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:21 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:22.343377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:22.343989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:22.350065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:22.350548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:22.350985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:22.351708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:22.352159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:22.352591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:22.422221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:22.430509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e01108e4-a5fa-430a-9bd0-00d4e4bd473a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.091057 Sep 19 11:53:22.431090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1570/3116] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:22.685072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:22.685622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:22.691720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:22.692208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:22.692645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:22.693335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:22.693795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:22.694223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:22.824249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:22.833381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:22.834807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:22.836019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-09cda129-29a9-42b9-a971-83cd35026219 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155544 Sep 19 11:53:22.837788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1547/3117] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:22.929896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:22.930510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:22.937958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:22.938387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:22.938834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:22.939569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:22.940036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:22.940576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:23.074025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:23.082139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-acd4a741-a04e-49f9-ac99-f79cc4f31c8c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156167 Sep 19 11:53:23.082700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1571/3118] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:22 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:23.454540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:23.455198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:23.461153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:23.461635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:23.462071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:23.462753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:23.463227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:23.463656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:23.526924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:23.535154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7ac019d9-3b6e-46a6-9cbc-f0d6b4609d10 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084511 Sep 19 11:53:23.535736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1548/3119] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:23.862267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:23.862796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:23.868860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:23.869351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:23.869786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:23.870506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:23.870998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:23.871459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:24.000302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:24.009168 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:24.010776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:24.012502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bb5b98bb-5836-4cd3-8feb-0ca44b7f5021 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154379 Sep 19 11:53:24.013058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1572/3120] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:24.106584 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:24.107247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:24.114057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:24.114478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:24.114915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:24.115644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:24.116100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:24.116738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:24.245423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:24.253770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-19378556-bcac-4e58-8004-e1bb1f569116 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151707 Sep 19 11:53:24.254338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1549/3121] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:24 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:24.557830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:24.559002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:24.565170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:24.565658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:24.566096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:24.566776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:24.567268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:24.567705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:24.630316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:24.639239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3f06b853-15ff-4abe-8b1e-9a3c2f02df2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085264 Sep 19 11:53:24.639813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1573/3122] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:25.038343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:25.038955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:25.045483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:25.045977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:25.046419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:25.047110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:25.047598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:25.048030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:25.176127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:25.184746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:25.186191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:25.187393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3d87eddf-c78c-4aa2-96d9-c62a2c7f6552 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153316 Sep 19 11:53:25.187963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1550/3123] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:25.278049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:25.278758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:25.285174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:25.285646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:25.286076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:25.286791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:25.287260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:25.287946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:25.415019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:25.423989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c28476a4-ad7d-45d9-8f90-5be3a36d5b45 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150399 Sep 19 11:53:25.424566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1574/3124] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:25 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:25.662701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:25.663272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:25.669259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:25.669744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:25.670180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:25.670864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:25.671354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:25.671778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:25.739660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:25.755125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-466a8687-df34-44b0-bc4d-572698d90bca tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.096648 Sep 19 11:53:25.755758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1551/3125] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:26.212902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:26.213525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:26.219580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:26.220067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:26.220510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:26.221201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:26.221657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:26.222084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:26.378385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:26.387093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:26.388588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:26.390073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-23564f3f-867e-4c37-b317-75764384b0fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.180783 Sep 19 11:53:26.390404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1575/3126] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:26.447151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:26.447763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:26.454265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:26.454749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:26.455202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:26.455897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:26.456352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:26.456777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:26.584951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:26.593109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-66f22ebd-7c93-470a-8e1e-a1c8411e33a0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149933 Sep 19 11:53:26.593676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1552/3127] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:26 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:26.779530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:26.780240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:26.786443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:26.786924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:26.787777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:26.788404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:26.788862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:26.789291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:26.853336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:26.862300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-20b1c1de-5063-4540-8ffa-d4d9d3ac3911 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087286 Sep 19 11:53:26.862879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1576/3128] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:27.415879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:27.416517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:27.423348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:27.423844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:27.424285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:27.424985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:27.425444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:27.425907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:27.554097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:27.562618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:27.564075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:27.565217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c8603fa5-ce95-4bbc-9085-659ff20bb4a9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153770 Sep 19 11:53:27.565769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1553/3129] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:27.616805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:27.617423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:27.623828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:27.624314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:27.624751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:27.625437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:27.625896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:27.626324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:27.759799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:27.769244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3c2bbccc-dc75-4ba4-8d89-4b543b41cbdf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156249 Sep 19 11:53:27.769821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1577/3130] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:27 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:27.885552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:27.886157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:27.892200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:27.892684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:27.893122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:27.893799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:27.894254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:27.894681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:27.957949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:27.966216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d736baac-05cb-4ebb-a71d-670b03adbf49 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084517 Sep 19 11:53:27.966790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1554/3131] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:28.591570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:28.592094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:28.598058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:28.598548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:28.598992 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:28.599715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:28.600180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:28.600613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:28.728680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:28.737337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:28.738783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:28.739973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-780634d5-47f3-4a71-8cef-b44b3c6b7db8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153085 Sep 19 11:53:28.740551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1578/3132] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:28.792529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:28.793152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:28.799639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:28.800121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:28.800617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:28.801247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:28.801705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:28.802134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:28.931288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:28.939965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fdc761bc-57cd-4ac1-9c36-c13b1baa89c4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151338 Sep 19 11:53:28.940541 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1555/3133] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:28 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:28.989480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:28.990088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:28.996519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:28.996995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:28.997420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:28.998089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:28.998583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:28.999001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:29.064936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:29.073207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-741260ca-473f-49f9-9a1e-bf3249ddc320 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087552 Sep 19 11:53:29.074397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1579/3134] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:29.766287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:29.766911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:29.773078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:29.773565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:29.774006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:29.774700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:29.775155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:29.775605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:29.781422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:29.907325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:29.916216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:29.917861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:29.919007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87c59142-acce-43aa-8dd0-3f11c79b0fc0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156733 Sep 19 11:53:29.919612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1556/3135] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:53:29.963821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:29.964517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:29.971057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:29.971573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:29.972033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:29.972735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:29.973186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:29.973606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:30.096928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:30.098281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:30.100149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:30.104460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:30.105594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:30.105914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:30.110569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:30.110569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:30.110569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:30.114357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4c20a32b-3601-4fb0-b8ce-60087540a80f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154494 Sep 19 11:53:30.114950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1580/3136] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:29 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:30.172934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:30.181087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-856e4ed8-962b-4179-93fa-0f056808d766 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088086 Sep 19 11:53:30.181656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1557/3137] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:30.945314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:30.945967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:30.953272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:30.953272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:30.953675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:30.954262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:30.954722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:30.955148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:31.093244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:31.102224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:31.103532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:31.104692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3779bce6-8dce-49b6-bafc-68cbca6c990a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.163425 Sep 19 11:53:31.105263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1581/3138] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:31.138515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:31.139159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:31.146042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:31.146521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:31.146956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:31.147674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:31.148143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:31.148571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:31.204985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:31.205507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:31.211513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:31.211997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:31.212437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:31.213130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:31.213584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:31.214015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:31.289054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:31.297284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-21e61ff9-023a-4ac8-97e9-4e8fe4ec5b4f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.096259 Sep 19 11:53:31.298493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1582/3139] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:31.311377 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:31.319895 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-73f0691d-6ecb-4967-8b9d-73f41aa07c6b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.185935 Sep 19 11:53:31.320466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1558/3140] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:31 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:32.129925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:32.130539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:32.137145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:32.137636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:32.138079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:32.138773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:32.139262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:32.139700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:32.158386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:32.268457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:32.277660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:32.279105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:32.282197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-130ac150-31f4-4c5d-a778-d8e4081be82f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156146 Sep 19 11:53:32.282776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1583/3141] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:32.322614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:32.323244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:32.330180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:32.330658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:32.331091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:32.331806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:32.332258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:32.332710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:32.349420 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:32.350031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:32.355962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:32.356447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:32.356888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:32.357574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:32.358027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:32.358454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:32.405346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:32.414074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-30f2c03a-470a-4943-934c-af79653c9eb7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.095351 Sep 19 11:53:32.414654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1559/3142] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:32.491661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:32.500089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-54902aad-04c9-460d-8ce8-609cb4f85dbc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154342 Sep 19 11:53:32.500551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1584/3143] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:32 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:33.308798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:33.309405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:33.315771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:33.316250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:33.316684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:33.317366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:33.317820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:33.318241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:33.437808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:33.438565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:33.445018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:33.445511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:33.446033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:33.446736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:33.447213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:33.447651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:33.448088 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:33.457472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:33.458964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:33.460193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-62f01ed5-6ca7-486f-a0c9-35b9f16c4dd8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155273 Sep 19 11:53:33.460762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1560/3144] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:33.508337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:33.517162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-31123429-8e3f-4017-878c-cba880b4a6d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083325 Sep 19 11:53:33.517736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1585/3145] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:33.523081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:33.523728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:33.529837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:33.530324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:33.530765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:33.531486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:33.531944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:33.532394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:33.665169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:33.673899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8af1bf27-4864-41b2-8d36-2282be592246 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154655 Sep 19 11:53:33.674473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1561/3146] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:33 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:34.485314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:34.485916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:34.492461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:34.492948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:34.493392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:34.494110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:34.494567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:34.495003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:34.540729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:34.541575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:34.548572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:34.549050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:34.549483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:34.550167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:34.550616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:34.551037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:34.626347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:34.634366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-be23cc79-a36c-4b98-82dd-bf2c4006b862 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.097822 Sep 19 11:53:34.634934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1562/3147] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:34.649825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:34.658569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:34.660047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:34.661209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7df8bcaf-7253-404a-8f76-e624ab29a031 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.179856 Sep 19 11:53:34.661818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1586/3148] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:34.697016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:34.697628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:34.703567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:34.704055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:34.704495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:34.705177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:34.705668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:34.706104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:34.835457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:34.843874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a184c4b5-44d8-4ec7-a610-d45da30fc62b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150647 Sep 19 11:53:34.844450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1563/3149] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:34 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:35.658835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:35.659494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:35.667741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:35.668238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:35.668682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:35.669388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:35.669841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:35.670276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:35.687967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:35.688572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:35.690824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:53:35.691019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c (ip 10.222.0.78) !!! Sep 19 11:53:35.703954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:35.704437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:35.704873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:35.705557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:35.706013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:35.706490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:35.736286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:35.745166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-39741190-e71d-44e7-88ef-00169d7ac515 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.091212 Sep 19 11:53:35.746254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1587/3150] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:35.841000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:35.850072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:35.851551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:35.852707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9751f20c-f7ba-4e44-b6c8-18795c3cd929 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.168684 Sep 19 11:53:35.853259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1564/3151] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:35 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:53:35.867558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:35.868165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:35.870228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:53:35.870907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:53:35.871961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:53:35.872117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:53:35.872969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:53:35.873094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 11:53:35 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:53:35.881551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:35.882038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:35.882476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:35.883194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:35.883666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:35.884099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:36.018996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:36.027332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-378312c7-1599-4b16-95af-219164822208 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.163588 Sep 19 11:53:36.027967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1588/3152] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:35 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:36.770087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:36.770724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:36.777804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:36.778284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:36.778715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:36.779428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:36.779885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:36.780307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:36.841417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:36.849696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0dd6f816-c675-4f24-b470-0cd0b3f874ff tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083679 Sep 19 11:53:36.850261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1565/3153] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:36.878304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:36.878936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:36.885419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:36.886416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:36.886853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:36.887721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:36.888187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:36.888701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:37.019488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:37.028763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:37.030150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:37.031990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5f64fd89-4ade-445d-809c-1308d3810aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156902 Sep 19 11:53:37.032632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1589/3154] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:37.051692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:37.052304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:37.058276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:37.058757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:37.059290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:37.059980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:37.060436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:37.060862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:37.189288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:37.197468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4024af75-b7ad-4317-bdff-6926088df10b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149615 Sep 19 11:53:37.198039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1566/3155] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:37 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:37.873539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:37.874148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:37.880401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:37.881032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:37.881326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:37.882021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:37.882480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:37.882916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:37.945119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:37.953921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4433588a-ba87-4fc3-a4d5-0ae69d368acf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084930 Sep 19 11:53:37.954493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1590/3156] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:38.058621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:38.059270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:38.065896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:38.066388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:38.066826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:38.067542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:38.068002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:38.068431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:38.200551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:38.209128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:38.210568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:38.211801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c6c68793-a7ea-4c33-8b44-f9c0a58e029c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157693 Sep 19 11:53:38.212344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1567/3157] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:38.221084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:38.221790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:38.227780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:38.228344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:38.228851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:38.229544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:38.230453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:38.230453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:38.359539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:38.368008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-82def972-e923-4296-bf45-bccfaa77a206 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150683 Sep 19 11:53:38.368576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1591/3158] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:38 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:38.976920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:38.977550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:38.983720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:38.984127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:38.984568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:38.985288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:38.985750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:38.986181 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:39.048289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:39.056979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-544ea2d6-b2f4-4d5a-904a-9b43cac9cc02 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083879 Sep 19 11:53:39.057574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1568/3159] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:39.237969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:39.238657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:39.244960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:39.245469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:39.245966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:39.246660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:39.247121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:39.247590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:39.377516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:39.386890 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:39.388378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:39.389579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe1d6aab-6d8b-497f-899a-69943b8441ab tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155613 Sep 19 11:53:39.390224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1592/3160] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:39.392099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:39.392745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:39.399527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:39.400011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:39.400443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:39.401135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:39.401627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:39.402049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:39.545091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:39.553373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-77aa6fb1-3ad2-4ce1-b862-905f7b92da2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.165393 Sep 19 11:53:39.553972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1569/3161] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:39 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:40.085227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:40.085783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:40.091818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:40.092294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:40.092728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:40.093403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:40.093852 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:40.094273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:40.155655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:40.164179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ff35ffe9-9695-4f31-90ce-819cd9195ad2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082847 Sep 19 11:53:40.164743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1593/3162] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:40.415977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:40.416523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:40.423982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:40.424473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:40.424917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:40.425618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:40.426111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:40.426542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:40.558436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:40.566940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:40.568405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:40.569565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b207d1b-ce22-4dc6-9c01-50ccbdb28a21 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158098 Sep 19 11:53:40.570113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1570/3163] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:40 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:40.577606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:40.578218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:40.584680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:40.585175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:40.585612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:40.586309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:40.586762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:40.587208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:40.715251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:40.723457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ca425fb-d1ab-4623-8aee-a151e999aaa0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150256 Sep 19 11:53:40.724030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1594/3164] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:40 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:41.187602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:41.188210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:41.194451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:41.194936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:41.195397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:41.196078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:41.196534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:41.196957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:41.261446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:41.269391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-12e3ce5c-672d-4fed-9f70-c8d212a41bcf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085805 Sep 19 11:53:41.269958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1571/3165] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:41.596176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:41.596783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:41.603404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:41.607111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:41.607111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:41.607111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:41.607111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:41.607555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:41.733940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:41.742804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:41.744286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:41.745977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-89d49330-17b6-4238-8cd0-48f6057f90c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153791 Sep 19 11:53:41.746298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:41.746838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1595/3166] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:41.746964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:41.753719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:41.754206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:41.754666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:41.755504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:41.756081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:41.756387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:41.885079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:41.889643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:41.896119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1bf47048-24c6-4ba1-9812-fb194841dd5b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154140 Sep 19 11:53:41.899014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1572/3167] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:41 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:42.294351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:42.294967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:42.301036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:42.301522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:42.301962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:42.302654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:42.303111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:42.303564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:42.366390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:42.375421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-86e57556-a852-4d8f-9c9b-339f880643fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085479 Sep 19 11:53:42.376097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1596/3168] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:42.775746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:42.776949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:42.783577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:42.784061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:42.784500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:42.785184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:42.785631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:42.786058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:42.917629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:42.919457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:42.920036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:42.926446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:42.926634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:42.926922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:42.927389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:42.927957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:42.928100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:42.928511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:42.928930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:42.929122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-55e49238-b4b3-499e-ade4-82436015d8db tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157695 Sep 19 11:53:42.929683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1573/3169] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:43.055666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:43.064039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9df414d3-0830-4ddf-b06c-48356b49be23 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148481 Sep 19 11:53:43.064618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1597/3170] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:42 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:43.398784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:43.399340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:43.405476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:43.405962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:43.406407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:43.407093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:43.407582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:43.408012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:43.471069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:43.479283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a0d5aa2c-852c-4bea-b913-536ee9dc7fae tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084479 Sep 19 11:53:43.479855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1574/3171] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:43.955374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:43.955948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:43.962502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:43.962972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:43.963445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:43.964143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:43.964597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:43.965044 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:44.087500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:44.088232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:44.094096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:44.094958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:44.095490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:44.095943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:44.096648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:44.097110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:44.097538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:44.102780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:44.104267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:44.105651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-53c44443-5ecb-447f-a0e1-a79c80677853 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154292 Sep 19 11:53:44.106476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1598/3172] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:44.226245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:44.234986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-899af5ee-0456-4816-81bd-4c1ecb7d898d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151425 Sep 19 11:53:44.235587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1575/3173] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:44 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:44.502430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:44.503066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:44.509522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:44.510001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:44.510436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:44.511133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:44.511617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:44.512038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:44.574916 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:44.583091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c218dc86-bfd4-4cc8-8c32-ed678e1cd00b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084597 Sep 19 11:53:44.583688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1599/3174] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:44 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:45.132371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:45.132976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:45.139426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:45.139905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:45.140336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:45.141017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:45.141466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:45.141885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:45.258582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:45.259337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:45.265609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:45.266090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:45.266521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:45.267305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:45.267682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:45.268099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:45.269750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:45.272255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:45.278815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:45.280361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:45.281544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23074ccd-152a-48a7-9df6-cc2171338e03 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153110 Sep 19 11:53:45.282110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1576/3175] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:45 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:45.397135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:45.405935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6a3a00c4-5890-4b61-af1e-3c50e89d609b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151269 Sep 19 11:53:45.406504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1600/3176] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:45 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:45.606594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:45.607229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:45.613168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:45.613654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:45.614091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:45.614785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:45.615262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:45.615687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:45.678881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:45.687042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-448fdb40-cad7-4b04-b128-b15af962e93d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084967 Sep 19 11:53:45.687717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1577/3177] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:46.309276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:46.309867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:46.316448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:46.316931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:46.317370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:46.318060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:46.318515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:46.318944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:46.429916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:46.430568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:46.437248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:46.437738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:46.438188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:46.438884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:46.439384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:46.439831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:46.446329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:46.455040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:46.456523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:46.457693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-19422a06-e20b-46af-a68b-1b5fe9085fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152413 Sep 19 11:53:46.458258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1601/3178] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:46.570054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:46.578885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7c4a209f-61a6-4cec-a7a1-fe757c249443 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152961 Sep 19 11:53:46.579491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1578/3179] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:46 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:46.710085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:46.710613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:46.717229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:46.717715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:46.718156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:46.718844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:46.719340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:46.719770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:46.786546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:46.795214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6857e7a3-5f59-4365-b2a8-5945b9b9eefc tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089023 Sep 19 11:53:46.795798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1602/3180] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:47.484976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:47.485537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:47.487832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=78 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:47.492488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:47.492968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:47.493419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:47.494075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:47.494528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:47.495553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:47.601997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:47.602725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:47.609213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:47.609886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:47.610418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:47.611196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:47.611728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:47.612245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:47.624402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:47.633060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:47.634512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:47.635715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-77127df6-13aa-489f-9f39-e5ce38aa0399 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154757 Sep 19 11:53:47.636278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1579/3181] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:47.743481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:47.752048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-147d4f3e-aa43-407d-abd9-9991bee09096 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154063 Sep 19 11:53:47.752619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1603/3182] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:47 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:47.818178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:47.818784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:47.824814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:47.825302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:47.825746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:47.826438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:47.826893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:47.827358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:47.890788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:47.899081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-57621c98-5ff0-4304-97e9-6181115723d9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084845 Sep 19 11:53:47.899671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1580/3183] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:48.662555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:48.663203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:48.665776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=80 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:48.670591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:48.671267 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:48.676732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:48.676732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:48.676732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:48.676732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:48.776653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:48.777561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:48.784334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:48.784816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:48.785247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:48.785933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:48.786484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:48.787183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:48.806927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:48.817564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:48.818993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:48.820184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-48e8d9d8-6245-46b3-a28c-9dfa364c151b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.161896 Sep 19 11:53:48.821004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1604/3184] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:48.917572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:48.923799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:48.924409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:48.925956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b157ebbd-bc9e-45b5-8d03-19d21f493fca tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153173 Sep 19 11:53:48.926528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1581/3185] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:48 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:48.930451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:48.930933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:48.931404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:48.932095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:48.933158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:48.933584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:48.996485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:49.004767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6d9b4749-4787-4729-b257-8309ca60d4c3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084925 Sep 19 11:53:49.005334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1605/3186] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:49.845587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:49.846193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:49.852922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:49.853414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:49.853856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:49.855060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:49.855620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:49.856038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:49.949521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:49.950231 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:49.956747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:49.957317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:49.957828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:49.958620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:49.959158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:49.959687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:49.986551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:49.995566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:49.997001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:49.998158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c89c8ee3-13b2-4bce-924e-6059b5f3feca tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156569 Sep 19 11:53:49.998718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1582/3187] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:50.028436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:50.028965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:50.035034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:50.035562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:50.035994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:50.036946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:50.037401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:50.037829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:50.113037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:50.122474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-295d30bc-add9-4ad8-9214-0a40093dde9a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.098378 Sep 19 11:53:50.122659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:50.123058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1583/3188] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:50.131283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a54f7a4c-b25b-46fc-8f00-e391f97571fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.185657 Sep 19 11:53:50.131859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1606/3189] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:49 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:51.023995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:51.024639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:51.031809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:51.032406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:51.032755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:51.033432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:51.033889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:51.034318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:51.146963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:51.147665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:51.154368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:51.154863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:51.155333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:51.156048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:51.156508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:51.156941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:51.180099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:51.189678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:51.191129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:51.192342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2f6717d0-1d3d-407b-9532-650f6d0cab7a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.172428 Sep 19 11:53:51.192916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1584/3190] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:51.197477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:51.198477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:51.205508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:51.206338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:51.206776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:51.207726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:51.208187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:51.209009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:51.227580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:51.236696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3b7ce3a7-a264-4d91-b77a-ee02bb891d0e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.094726 Sep 19 11:53:51.237487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1607/3191] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:51.589948 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:51.598184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-341719a5-61ef-4f55-b16e-453187ce26fc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.404325 Sep 19 11:53:51.598745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1585/3192] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:51 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:52.220307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:52.220907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:52.227483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:52.227966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:52.228404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:52.229740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:52.230195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:52.230621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:52.261187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:52.261771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:52.268494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:52.269113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:52.269557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:52.270245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:52.270697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:52.271119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:52.352424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:52.361811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9d586ec1-7b6c-4ce2-a9e7-71a32e67a2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.104575 Sep 19 11:53:52.362401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1586/3193] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:53:52.384715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:52.393699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:52.395148 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:52.396381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9fccf90e-21f8-47ba-b809-3da2ca581700 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.180035 Sep 19 11:53:52.396948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1608/3194] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:52.621785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:52.622306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:52.628258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:52.628736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:52.629164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:52.629835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:52.630281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:52.630697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:52.759973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:52.768765 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ccd61698-797f-4847-98af-458d21798f4c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150882 Sep 19 11:53:52.769367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1587/3195] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:52 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:53.385224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:53.385791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:53.392312 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:53.392804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:53.393249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:53.393952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:53.394414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:53.394844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:53.422674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:53.423478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:53.429940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:53.430427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:53.430868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:53.431586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:53.432773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:53.433205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:53.458392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:53.466733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ab35c24f-99eb-490a-94d6-a428e21d7544 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085472 Sep 19 11:53:53.467356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1609/3196] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:53.561512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:53.570359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:53.571848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:53.573051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ffa5647f-8969-4fed-a3fd-d4723e77c785 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154408 Sep 19 11:53:53.573614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1588/3197] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:53:53.792697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:53.793306 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:53.799261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:53.799746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:53.800178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:53.800897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:53.801350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:53.801782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:53.936251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:53.944814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bd984403-c512-44c5-adf4-555235a0e4dd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156581 Sep 19 11:53:53.945384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1610/3198] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:53 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:54.491461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:54.492091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:54.499161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:54.499683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:54.500121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:54.500828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:54.501282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:54.501705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:54.524968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:54.570890 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:54.581674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-852e4362-2f87-4cbb-afd9-ce0a0a5b2530 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.094743 Sep 19 11:53:54.582267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1589/3199] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:54 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:54.602187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:54.602809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:54.610200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:54.610692 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:54.611145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:54.611880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:54.612342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:54.612774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:54.750741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:54.759473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:54.761429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:54.762603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d36c5237-01d3-46c8-bb19-b1c9095b3ac6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.167212 Sep 19 11:53:54.763179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1611/3200] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:54.969208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:54.969817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:54.975833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:54.976318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:54.976758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:54.977437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:54.977889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:54.978393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:55.104081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:55.112441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-51e7bd81-f8bc-4c76-9cae-81e0c79aeb1c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.147005 Sep 19 11:53:55.113029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1590/3201] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:54 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:55.604677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:55.605414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:55.611914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:55.612400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:55.612840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:55.613534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:55.613990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:55.614419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:55.675346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:55.683525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-91271a2f-1046-4518-b0fb-effb096607d5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082719 Sep 19 11:53:55.684087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1612/3202] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:55.789424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:55.790024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:55.796986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:55.797462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:55.797892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:55.798570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:55.799017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:55.799467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:55.930536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:55.939272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:55.940719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:55.941880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-850539b0-b3ba-4d1f-8323-a7d197c80bc7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.156709 Sep 19 11:53:55.942438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1591/3203] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:55 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:56.135664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:56.136210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:56.142199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:56.142680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:56.143118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:56.143831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:56.144286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:56.144711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:56.272208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:56.280575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8ea680d5-8d57-4a08-91a0-5fadc9ce9623 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148799 Sep 19 11:53:56.281118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1613/3204] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:56 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:56.707661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:56.708275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:56.715050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:56.715567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:56.716010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:56.716705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:56.717164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:56.717591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:56.778530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:56.787251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07500dca-4bb4-4d26-98a8-8d41b7bd6271 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083529 Sep 19 11:53:56.787814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1592/3205] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:56.968108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:56.968660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:56.975056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:56.975603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:56.976047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:56.976735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:56.977192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:56.977627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:57.112432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:57.122290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:57.123776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:57.124999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c7fd3a45-a256-442a-a837-f109502fff6d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.160931 Sep 19 11:53:57.125571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1614/3206] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:57.303317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:57.303933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:57.310919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:57.311445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:57.311885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:57.312576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:57.313033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:57.313461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:57.442213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:57.450397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07d3aa9f-4182-498b-8415-91f9577fee9d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150960 Sep 19 11:53:57.450966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1593/3207] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:57 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:57.811275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:57.811897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:57.817969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:57.818455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:57.818893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:57.819610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:57.820072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:57.820506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:57.880827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:57.889053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-40d34944-4815-448b-abea-2f2c2b6ec712 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082384 Sep 19 11:53:57.889618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1615/3208] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:58.151109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:58.151762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:58.157836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:58.158317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:58.158749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:58.159482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:58.159915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:58.160340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:58.292585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:58.301278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:58.302640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:58.303824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dcccd09d-a79d-4969-9a5e-91807aaf537e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157139 Sep 19 11:53:58.304397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1594/3209] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:58.474169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:58.474783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:58.482108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:58.482597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:58.483041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:58.483761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:58.484219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:58.484651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:58.615858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:58.619230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:53:58.624213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-149fd61b-3548-4a3f-82ef-beee48d0be22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153949 Sep 19 11:53:58.624777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1616/3210] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:58 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:58.912457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:58.912982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:58.919490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:58.919984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:58.920422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:58.921114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:58.921570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:58.922041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:58.982317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:58.990497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4e556e54-f06e-44d4-99eb-4e8c51a52861 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082282 Sep 19 11:53:58.991063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1595/3211] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:53:59.329782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:59.330389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:59.336671 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:59.342588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:59.342588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:59.342588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:59.342588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:59.343207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:59.472713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:59.482232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:59.483698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:59.484856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-27e5affc-1853-48bd-ae7e-2fb654fd078d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.159405 Sep 19 11:53:59.485418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1617/3212] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:53:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:53:59.647970 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:53:59.648517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:53:59.654894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:59.655410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:59.655852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:59.656537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:53:59.656993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:53:59.657419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:53:59.784870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:53:59.794227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-af86b155-456e-48be-9541-4e2ce926c19b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150182 Sep 19 11:53:59.794796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1596/3213] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:53:59 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:00.014087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:00.014721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:00.020785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:00.021266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:00.021698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:00.022378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:00.022834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:00.023285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:00.091062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:00.099384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-47e81695-055d-476b-bc7e-5664d41ac486 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089628 Sep 19 11:54:00.099980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1618/3214] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:00.512615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:00.513228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:00.519714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:00.520200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:00.520637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:00.521324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:00.521779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:00.522212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:00.651671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:00.660761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:00.662473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:00.663676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-438d8d2c-098b-46b3-b1de-a7fc786711e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155645 Sep 19 11:54:00.664242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1597/3215] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:00 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:00.816576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:00.817137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:00.823561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:00.824037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:00.824470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:00.825150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:00.825601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:00.826021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:00.955555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:00.963806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d4e32004-0b65-4bee-bea2-734ab5262ae1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151129 Sep 19 11:54:00.964464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1619/3216] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:00 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:01.122301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:01.129508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:01.129508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:01.129508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:01.129866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:01.130416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:01.130870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:01.131337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:01.194446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:01.203443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4de7c391-5471-440d-9bf5-2731b4d0e9c9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085427 Sep 19 11:54:01.204013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1598/3217] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:01.689591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:01.690205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:01.696309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:01.696813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:01.697235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:01.697922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:01.698383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:01.698813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:01.828224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:01.836974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:01.838786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:01.839996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6cfc43e3-4c0c-46f8-b8ce-a5767e29f0c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154493 Sep 19 11:54:01.840570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1620/3218] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:01.987602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:01.988188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:01.994491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:01.998362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:01.998362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:01.998362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:01.998362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:01.998758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:02.131595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:02.139805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ac651f65-6d87-4b5d-b35c-43263daf6f52 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156110 Sep 19 11:54:02.140375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1599/3219] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:01 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:02.225923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:02.226540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:02.233328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:02.233846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:02.234289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:02.234978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:02.235465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:02.235901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:02.300360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:02.309031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-65958420-d6b2-4fd6-8c14-76eba0197a4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086970 Sep 19 11:54:02.309604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1621/3220] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:02.866091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:02.866690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:02.873206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:02.873682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:02.874113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:02.874791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:02.875264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:02.875687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:03.004191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:03.013365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:03.014822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:03.016018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6d8ea98e-6c92-4f7a-82fe-1b898f6af6bc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153873 Sep 19 11:54:03.016583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1600/3221] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:03.168495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:03.169103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:03.175455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:03.175941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:03.176371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:03.177050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:03.177496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:03.177917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:03.310360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:03.318528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a5b3377-bc9a-4d8b-9dcf-d5bb06120162 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154433 Sep 19 11:54:03.319104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1622/3222] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:03 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:03.332590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:03.333209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:03.339198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:03.339683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:03.340121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:03.340802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:03.341255 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:03.341679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:03.406144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:03.414869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-386d1533-9a58-47e8-a54a-4dfa5de46caa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086161 Sep 19 11:54:03.416762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1601/3223] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:04.042050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:04.042664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:04.048974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:04.049465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:04.049909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:04.050605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:04.051067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:04.051530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:04.191030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:04.200955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:04.202383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:04.203573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-380f253c-7f4f-4955-9e25-9abfec31f837 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.165488 Sep 19 11:54:04.204378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1623/3224] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:04.342283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:04.342946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:04.349306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:04.349798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:04.350243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:04.350931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:04.351415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:04.351844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:04.438195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:04.438806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:04.444848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:04.445425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:04.445771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:04.446465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:04.446919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:04.447376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:04.482158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:04.490375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dc620921-1c8d-4978-875d-1500d6b1dcf5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152165 Sep 19 11:54:04.490955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1602/3225] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:04 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:04.513345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:04.521680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-95a4d8bd-09c0-454f-b3ae-84932f662b27 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087430 Sep 19 11:54:04.522246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1624/3226] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:05.231611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:05.232228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:05.238261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:05.238748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:05.239208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:05.239902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:05.240359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:05.240793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:05.368651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:05.377269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:05.378729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:05.379915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a2c5a6f1-fd90-4662-bd95-d6c523075e79 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152905 Sep 19 11:54:05.380466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1603/3227] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:05 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:05.514335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:05.514958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:05.521480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:05.521962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:05.522402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:05.523095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:05.523579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:05.524011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:05.546875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:05.547804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:05.553891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:05.554374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:05.554818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:05.555572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:05.555999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:05.556425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:05.639956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:05.648516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d37fc0f2-fc57-4398-a036-9cf3342c5f83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.105043 Sep 19 11:54:05.649089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1604/3228] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:05.679630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:05.688171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5d0f0cc6-37cd-4939-83fb-3a3ed8b71726 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.178233 Sep 19 11:54:05.688746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1625/3229] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:05 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:06.405557 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:06.406161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:06.412941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:06.413424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:06.413862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:06.414563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:06.415018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:06.415474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:06.542661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:06.551342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:06.552789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:06.553949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-62a4fa1e-5330-44fd-8a95-e7e9680b4732 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152442 Sep 19 11:54:06.554516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1605/3230] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:06.672578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:06.673159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:06.679662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:06.680150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:06.680609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:06.681291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:06.681750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:06.682181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:06.712174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:06.713298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:06.719361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:06.719849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:06.720285 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:06.720975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:06.721433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:06.721943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:06.725913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:06.747314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:06.755777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-266dcc43-1261-4458-b9e8-6e58b4605c01 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087213 Sep 19 11:54:06.756361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1626/3231] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:06.858187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:06.872217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6268fc1a-6898-4d61-be82-491e47f0a732 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.163921 Sep 19 11:54:06.872816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1606/3232] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:06 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:07.579855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:07.580462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:07.586385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:07.586868 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:07.587337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:07.588982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:07.589440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:07.589871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:07.721070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:07.729847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:07.731624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:07.732793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f3368100-ac41-472c-987e-d5817151b305 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157261 Sep 19 11:54:07.733357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1627/3233] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:07.779594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:07.780244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:07.787008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:07.787533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:07.787982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:07.788679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:07.789140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:07.789568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:07.850562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:07.858851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ba0f8e17-332d-4894-904a-86752bfffab1 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083825 Sep 19 11:54:07.859459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1607/3234] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:07.895142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:07.895825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:07.901790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:07.902278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:07.902720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:07.903672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:07.904128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:07.904562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:08.038655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:08.046981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d28bb69b-64f9-45c2-9f07-93f2271b364a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.155691 Sep 19 11:54:08.047584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1628/3235] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:07 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:08.758481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:08.759093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:08.765481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:08.765968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:08.766408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:08.767099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:08.767591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:08.768017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:08.881883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:08.882497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:08.888912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:08.889394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:08.889827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:08.890511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:08.890959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:08.891407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:08.896595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:08.905954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:08.907559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:08.908812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8fa7d7b9-8ae1-40ef-8cb7-7c40b0876a5c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154271 Sep 19 11:54:08.909680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1608/3236] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:08.953510 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:08.961804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c50f2fa3-a6b7-4baa-8a59-860587b08e4d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083795 Sep 19 11:54:08.962375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1629/3237] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:09.071013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:09.071558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:09.078098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:09.078574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:09.079009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:09.079720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:09.080170 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:09.080589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:09.212589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:09.221247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa74454f-9002-4902-9ae2-51bd36be33ac tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154224 Sep 19 11:54:09.221801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1609/3238] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:09 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:09.936136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:09.936782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:09.943286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:09.943776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:09.944232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:09.944915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:09.945373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:09.945800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:09.985581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:09.986290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:09.992841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:09.993431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:09.994620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:09.995457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:09.995988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:09.996417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:10.069942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:10.078179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4675d71b-b98f-4525-9853-b23a75ae5578 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.096524 Sep 19 11:54:10.078756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1610/3239] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:09 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:10.099358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:10.108561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:10.110007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:10.111216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85d53e04-99aa-4a9d-a4ab-593fdfc77f55 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.179979 Sep 19 11:54:10.111792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1630/3240] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:10.244100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:10.244704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:10.250602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:10.251090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:10.251546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:10.252227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:10.252675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:10.253092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:10.385445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:10.398120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f000cf5c-d50f-4e34-9225-6e5c64ae282e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157910 Sep 19 11:54:10.398702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1611/3241] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:10 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:11.101530 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:11.102144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:11.109376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:11.109864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:11.110308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:11.111006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:11.111492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:11.111923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:11.137911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:11.138525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:11.145401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:11.146160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:11.146625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:11.147378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:11.147835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:11.148443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:11.174902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:11.183563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-800dc218-fa09-4385-9aa4-6cfa12c316ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085862 Sep 19 11:54:11.184150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1631/3242] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:11.279757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:11.288885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:11.290360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:11.292066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b92fc29-407f-45a8-ac8a-e73085a6f4d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158124 Sep 19 11:54:11.296675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1612/3243] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:11.422605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:11.423256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:11.429251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:11.429734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:11.430171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:11.430862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:11.431988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:11.432360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:11.559382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:11.567703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d232da97-be1b-4a2e-8118-b24786dd2a22 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149107 Sep 19 11:54:11.568304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1632/3244] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:11 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:12.208374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:12.209307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:12.221148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:12.221628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:12.222068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:12.222762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:12.223240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:12.223668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:12.284972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:12.293695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa0f8710-156c-4667-9043-8fa2bbf15931 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090712 Sep 19 11:54:12.294269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1613/3245] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:12.317906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:12.318518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:12.325652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:12.326405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:12.326865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:12.327573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:12.328027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:12.328508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:12.346906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:12.462903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:12.471810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:12.473275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:12.474454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5da231ee-097f-4df0-962e-82d47546ca07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.160476 Sep 19 11:54:12.475022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1633/3246] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:12.590084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:12.590701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:12.597050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:12.597537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:12.597974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:12.598674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:12.599124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:12.599587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:12.730558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:12.738742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9d953432-385b-47fc-b0df-66a4fd51dfd2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.152669 Sep 19 11:54:12.739340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1614/3247] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:12 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:13.316821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:13.317438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:13.324001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:13.324588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:13.324919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:13.325610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:13.326071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:13.326502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:13.388684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:13.397072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-44f1db51-862f-42f6-915b-61667f479cab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084113 Sep 19 11:54:13.397648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1634/3248] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:13.499365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:13.500011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:13.506543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:13.507025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:13.507503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:13.508192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:13.508647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:13.509074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:13.640994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:13.649567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:13.651656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:13.652818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b6018bf3-82dc-41b8-ac3e-4d9984a80df9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157435 Sep 19 11:54:13.653449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1615/3249] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:13.762609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:13.763311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:13.769541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:13.770118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:13.770633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:13.771489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:13.771963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:13.772405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:13.905616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:13.914500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-edea6f3b-7c2a-44cc-9e2e-21df10ecc75a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.156358 Sep 19 11:54:13.915065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1635/3250] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:13 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:14.421477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:14.422090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:14.428275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:14.428764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:14.429203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:14.429889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:14.430348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:14.430776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:14.491823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:14.500749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f9882aad-e2dc-4327-aef2-a517bceeca8f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083307 Sep 19 11:54:14.501310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1616/3251] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:14.679073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:14.679677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:14.686056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:14.686538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:14.686993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:14.687686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:14.688136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:14.688561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:14.818617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:14.827163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:14.828624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:14.829766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5ba86edb-294f-456e-b7b6-27992a1fa05e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154789 Sep 19 11:54:14.830315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1636/3252] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:14.938409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:14.938946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:14.945419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:14.945907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:14.946351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:14.947699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:14.948158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:14.948589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:15.076487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:15.085457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cdab7bb3-565c-40b4-b086-9c6be48ff97a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151061 Sep 19 11:54:15.086041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1617/3253] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:14 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:15.523317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:15.523928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:15.529965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:15.530440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:15.530875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:15.531581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:15.532024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:15.532445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:15.593659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:15.602027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3181dd34-9af7-4bac-97b2-2e8003e6c87d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082557 Sep 19 11:54:15.602599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1637/3254] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:15.855696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:15.856309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:15.862343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:15.862833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:15.863299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:15.863990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:15.864450 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:15.864879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:15.996436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:16.005057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:16.006494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:16.007691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-853e734d-9bc2-4bcc-8ac1-9666f1ee9b99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155926 Sep 19 11:54:16.008250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1618/3255] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:16.108555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:16.109120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:16.115664 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:16.116152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:16.116925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:16.117276 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:16.117734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:16.118175 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:16.252426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:16.264407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f7f18a7e-4628-41f0-9107-2e839828b349 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.159259 Sep 19 11:54:16.265004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1638/3256] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:16 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:16.625923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:16.626536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:16.633772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:16.634254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:16.634691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:16.635405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:16.635860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:16.636287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:16.700062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:16.708336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a10e058b-b679-419f-8624-d96bd516a30f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086259 Sep 19 11:54:16.708909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1619/3257] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:17.034051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:17.034667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:17.041723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:17.042202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:17.042655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:17.043395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:17.043860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:17.044288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:17.173068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:17.181930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:17.183415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:17.184591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d5c8846a-d1bc-408f-9d53-70b64ae424d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154588 Sep 19 11:54:17.185149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1639/3258] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:17.288372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:17.288925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:17.295504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:17.295996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:17.296432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:17.297122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:17.297582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:17.298004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:17.426716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:17.435517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e8a1ac5b-2ca9-4977-921f-8013cdfee5f0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151371 Sep 19 11:54:17.436092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1620/3259] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:17 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:17.731287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:17.731934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:17.738305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:17.738793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:17.739263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:17.739989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:17.740412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:17.740836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:17.806269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:17.814565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6ad4ce2d-bd53-4aaf-8fb0-db035291a54e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087785 Sep 19 11:54:17.815137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1640/3260] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:18.209960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:18.211286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:18.213722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=84 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:18.218378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:18.218870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:18.219347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:18.220046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:18.220537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:18.220965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:18.356066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:18.365222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:18.366724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:18.367927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8bbddde4-ae81-4a31-ba55-23700ec04c42 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.161834 Sep 19 11:54:18.369032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1621/3261] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:18.458928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:18.459784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:18.466384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:18.467028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:18.467449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:18.468197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:18.468602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:18.469030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:18.599885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:18.608836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ffda6696-706a-4ecc-b3fa-fc8f37a912ad tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.153750 Sep 19 11:54:18.609410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1641/3262] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:18 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:18.838480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:18.839078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:18.845033 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:18.845508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:18.845941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:18.846614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:18.847061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:18.847514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:18.911738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:18.915106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:18.920319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-64181a0d-a9a4-4674-81ef-c4570e2b0ece tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086416 Sep 19 11:54:18.921114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1622/3263] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:19.394831 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:19.395387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:19.397994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=76 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:19.402715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:19.407462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:19.407462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:19.407462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:19.407462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:19.407892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:19.533503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:19.543357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:19.544815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:19.545987 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-040993c7-0daa-47bd-80da-bede92aff7a8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155308 Sep 19 11:54:19.546556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1642/3264] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:19.632592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:19.633210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:19.639852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:19.640341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:19.640771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:19.641461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:19.641916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:19.642345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:19.769816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:19.778051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1a450916-bcf3-4210-ad3e-3e5f12fbc23e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149715 Sep 19 11:54:19.778614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1623/3265] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:19 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:19.948713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:19.949324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:19.955326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:19.955811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:19.956245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:19.956927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:19.957381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:19.957809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:20.029054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:20.037637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e4fc8470-af3e-452f-ada2-fe3973c0790c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.092880 Sep 19 11:54:20.038226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1643/3266] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:19 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:20.572897 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:20.573517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:20.579575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:20.580053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:20.580484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:20.581154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:20.581601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:20.582042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:20.709395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:20.718172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:20.719621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:20.720767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b37bae8c-ea34-44ae-a9cd-c6973728cba1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152345 Sep 19 11:54:20.721316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1624/3267] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:20 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:20.801819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:20.802431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:20.809383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:20.809871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:20.810314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:20.811004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:20.811496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:20.811928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:20.938126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:20.946388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2485868d-5d0e-4968-bb61-ed4ea63df638 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.148401 Sep 19 11:54:20.947553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1644/3268] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:20 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:21.061836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:21.062488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:21.068600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:21.069084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:21.069524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:21.070214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:21.070671 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:21.071147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:21.135599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:21.144193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b00cd891-e7bb-49db-bea8-88c7cc8bd6d2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086220 Sep 19 11:54:21.144694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1625/3269] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:21.746353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:21.746988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:21.753155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:21.753633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:21.754077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:21.754758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:21.755236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:21.755672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:21.884695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:21.893317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:21.894770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:21.895935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a128b24b-13aa-4eab-81f3-f4b6452ab5a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153573 Sep 19 11:54:21.896486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1645/3270] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:21.970031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:21.970637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:21.977056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:21.977534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:21.977967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:21.978646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:21.979096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:21.979543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:22.108518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:22.117321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ea608f3e-0efc-4ace-8f18-d44b27b642db tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150917 Sep 19 11:54:22.117710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1626/3271] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:21 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:22.167283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:22.167900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:22.173940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:22.174425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:22.174879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:22.175597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:22.176057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:22.176490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:22.239556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:22.248328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b0c71ec3-ee82-4bc5-b2ed-6092f2700571 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084987 Sep 19 11:54:22.248928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1646/3272] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:22.922498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:22.923130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:22.929253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:22.929741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:22.930175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:22.930880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:22.931345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:22.931772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:23.062013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:23.070923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:23.072408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:23.073579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-969cd80a-cefc-4860-93a1-570ac87e6df4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155069 Sep 19 11:54:23.074149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1627/3273] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:23.140906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:23.141547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:23.148249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:23.148746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:23.149189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:23.150450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:23.150911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:23.151373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:23.272534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:23.273032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:23.279310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:23.279801 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:23.280239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:23.281112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:23.281577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:23.282029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:23.286205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:23.294971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fc93f569-bd78-47a3-beef-a6fda75c8ef8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.157942 Sep 19 11:54:23.295594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1647/3274] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:23 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:23.346982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:23.355872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-705511ac-ae21-4a1e-9484-647ea35d0037 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087446 Sep 19 11:54:23.356479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1628/3275] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:24.100234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:24.100760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:24.107613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:24.108107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:24.108550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:24.109303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:24.109774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:24.110209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:24.237527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:24.247131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:24.248613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:24.249780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7de7cadb-578e-4d1c-ac51-dd29179c962f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153836 Sep 19 11:54:24.250343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1648/3276] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:24.317843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:24.318456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:24.324967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:24.325445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:24.325880 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:24.326577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:24.327029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:24.328221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:24.387056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:24.389192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:24.394491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:24.394994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:24.395469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:24.396368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:24.396887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:24.397283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:24.481263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:24.489266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-67d6cc84-45dd-48da-a51c-f35c89f11341 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.106055 Sep 19 11:54:24.489853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1649/3277] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:24 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:24.513814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:24.513814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9320ef59-4805-4022-961f-2bc113401dd8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.192230 Sep 19 11:54:24.513814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1629/3278] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:24 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:25.275419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:25.276088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:25.282577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:25.283065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:25.283541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:25.284240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:25.284704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:25.285138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:25.289514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:25.417221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:25.426137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:25.427619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:25.428759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5034911b-75ac-4017-9d09-b93c7f05b3a3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157370 Sep 19 11:54:25.429322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1650/3279] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:25 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:25.513260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:25.513885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:25.521798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:25.521798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:25.521798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:25.522243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:25.522701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:25.523128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:25.534825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:25.535876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:25.542759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:25.543158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:25.543628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:25.544367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:25.544825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:25.545319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:25.611060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:25.620860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-94516288-f3c7-4905-823b-66e0d96c1721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.112207 Sep 19 11:54:25.621454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1630/3280] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:25.702054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:25.710521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4769721c-8eec-4835-af63-4713b5629c5c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.179644 Sep 19 11:54:25.711107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1651/3281] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:25 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:26.455812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:26.456357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:26.462298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:26.462773 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:26.463228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:26.463905 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:26.464352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:26.464770 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:26.590686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:26.599318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:26.600817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:26.601985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-97569128-e120-48ae-ada9-54281aec49e7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.150205 Sep 19 11:54:26.603077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1631/3282] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:26.644623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:26.645227 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:26.653812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:26.654287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:26.654717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:26.655441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:26.655888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:26.656303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:26.719600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:26.728860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fb51226d-3664-437e-971a-87b5c641aed4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087951 Sep 19 11:54:26.729505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1652/3283] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:26.734324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:26.734969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:26.741302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:26.741792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:26.742244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:26.742940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:26.743505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:26.743938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:26.912915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:26.922219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-58e6ad86-8187-4c27-ae89-f43c0ab76525 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.191727 Sep 19 11:54:26.922812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1632/3284] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:26 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:27.628711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:27.629315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:27.635870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:27.636345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:27.636776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:27.637452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:27.637901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:27.638330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:27.752360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:27.752982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:27.760214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:27.760707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:27.761147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:27.761851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:27.762314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:27.762744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:27.768383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:27.777262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:27.778716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:27.780087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-19ef6402-b86e-4bf5-8c34-6732bb2972a2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155260 Sep 19 11:54:27.780839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1653/3285] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:27.829489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:27.837791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6835a6e3-25c9-4fe1-96c8-2092c3caa96d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089485 Sep 19 11:54:27.838370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1633/3286] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:27.945761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:27.946381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:27.952474 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:27.952953 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:27.953392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:27.954076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:27.954531 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:27.954957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:28.085236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:28.093538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b2a72113-a531-4659-a7f9-ca99184498d5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151736 Sep 19 11:54:28.094107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1654/3287] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:27 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:28.807946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:28.808549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:28.814969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:28.815495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:28.815933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:28.816620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:28.817072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:28.817493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:28.861577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:28.862200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:28.869193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:28.869679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:28.870124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:28.870824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:28.871309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:28.871745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:28.947574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:28.956388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b3a3a9c9-93a7-4da2-86c1-342124547344 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.098697 Sep 19 11:54:28.957350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1655/3288] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:28.975341 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:28.984049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:28.985499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:28.986672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4b098c9f-48b9-454d-8953-c907a1c5a4a5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.182721 Sep 19 11:54:28.987252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1634/3289] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:29.117425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:29.118087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:29.124110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:29.124550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:29.124991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:29.125678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:29.126136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:29.126568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:29.256065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:29.264804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bb589034-2931-4dc8-af9d-e02d6679779d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151272 Sep 19 11:54:29.265369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1656/3290] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:29 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:29.980659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:29.981294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:29.990030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:29.990522 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:29.990971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:29.991706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:29.992161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:29.992588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:30.013529 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:30.014178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:30.020640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:30.021130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:30.021743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:30.022443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:30.022904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:30.023369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:30.056996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:30.065494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-86302187-63ee-41a8-b984-50dacba69322 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089239 Sep 19 11:54:30.066083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1635/3291] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:29 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:30.156314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:30.165658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:30.167091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:30.168264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ef02f85-0aff-4dc2-a22d-c083a588ff90 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.158789 Sep 19 11:54:30.168810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1657/3292] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:30 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:30.288629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:30.289228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:30.295642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:30.296117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:30.296547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:30.297217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:30.297662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:30.298110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:30.430466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:30.438636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ab12b946-6b67-4d02-b759-f364f77f2036 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.154093 Sep 19 11:54:30.439216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1636/3293] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:30 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:31.088743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:31.089352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:31.095962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:31.096456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:31.096922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:31.097613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:31.098071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:31.098499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:31.160972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:31.169858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-905dcfd5-406d-4fa7-b604-6b8c52a14aa2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085025 Sep 19 11:54:31.170425 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1658/3294] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:31.194166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:31.194785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:31.201330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:31.201823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:31.202262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:31.202957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:31.203429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:31.203850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:31.335508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:31.344545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:31.345978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:31.347193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3c578bdf-a17a-4637-90d9-447a51b9ecaa tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157021 Sep 19 11:54:31.347740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1637/3295] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:31.461499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:31.462602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:31.468616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:31.469105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:31.469546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:31.470235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:31.470693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:31.471120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:31.600656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:31.609167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-46577771-ea7a-46fc-9dc4-aee45142960a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151575 Sep 19 11:54:31.609735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1659/3296] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:31 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:32.192887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:32.193495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:32.200193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:32.200846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:32.201078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:32.201752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:32.202200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:32.202623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:32.262781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:32.271291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7bd38f1a-a1df-4a37-920c-318e2963c0a0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082282 Sep 19 11:54:32.271867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1638/3297] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:32.374092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:32.374642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:32.381049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:32.381522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:32.381976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:32.382658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:32.383107 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:32.383556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:32.522418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:32.530886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:32.532352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:32.533502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f7dedd62-3e99-47b3-af9d-51dd4bba1d5a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.163410 Sep 19 11:54:32.534053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1660/3298] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:32.632219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:32.632760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:32.638903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:32.639415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:32.639852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:32.640535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:32.640986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:32.641411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:32.660512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:32.770072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:32.778858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ac13a103-70b5-4235-93f3-e1412557a9dc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150562 Sep 19 11:54:32.779572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1639/3299] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:32 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:33.294650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:33.295292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:33.301354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:33.301839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:33.302282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:33.303000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:33.303558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:33.303989 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:33.367320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:33.376253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-75fef99d-acbb-4fe8-8fa2-5f832e94006e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085468 Sep 19 11:54:33.377006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1661/3300] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:33.560016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:33.560608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:33.567114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:33.567626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:33.568057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:33.568729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:33.569178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:33.569600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:33.697477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:33.705980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:33.707461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:33.708629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07b98db7-6312-4ef4-96ee-24eec1538b04 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.152606 Sep 19 11:54:33.709194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1640/3301] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:33.802379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:33.803032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:33.809610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:33.810084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:33.810517 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:33.811229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:33.811688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:33.812112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:33.939848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:33.948802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e6b2fe74-efa4-45fa-ac20-3613c51a7ba2 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.150382 Sep 19 11:54:33.949376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1662/3302] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:33 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:34.401386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:34.402003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:34.408301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:34.408799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:34.409243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:34.410204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:34.410679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:34.411114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:34.477280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:34.485610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b5fde748-d853-490d-ad5c-24a564239bf9 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089633 Sep 19 11:54:34.486178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1641/3303] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:34 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:34.744211 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:34.744796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:34.753615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:34.754263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:34.754714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:34.755464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:34.755927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:34.756361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:34.973409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:34.974016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:34.981005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:34.982163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:34.982618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:34.983366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:34.983829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:34.984262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:35.194131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:35.202872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:35.204166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:35.205182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:35.205339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dd8401f6-1f1b-492f-b0ef-1a4cc93b1ce0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.473801 Sep 19 11:54:35.205907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1663/3304] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:35.214027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c96e8c8c-a3ef-4183-9e0e-160ea02ea0a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.245045 Sep 19 11:54:35.214592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1642/3305] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:34 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:35.509931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:35.510542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:35.516481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:35.516957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:35.517392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:35.518073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:35.518527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:35.518948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:35.583795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:35.592698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ef5ca4a6-f5a2-4e0b-aa9b-be307b2aec73 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087247 Sep 19 11:54:35.593277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1664/3306] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:36.232075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:36.232747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:36.237129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:36.237745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:36.239384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:36.239872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:36.240311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:36.241079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:36.241539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:36.241966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:36.244976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:36.245467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:36.245907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:36.246603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:36.247061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:36.247523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:36.438418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:36.443974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:36.447311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:36.448769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:36.450499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a6ee6d8b-dc21-4e3c-9755-0681e4fc696c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.222339 Sep 19 11:54:36.451073 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1643/3307] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:36.453521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0f9170ce-d120-496f-b221-c9acb1dc61a1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.220049 Sep 19 11:54:36.454192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1665/3308] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:36 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:36.615092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:36.615732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:36.621839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:36.622326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:36.622767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:36.623486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:36.623949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:36.624381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:36.686299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:36.694594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a27b1e38-c12f-4865-b037-f356d588cd83 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083397 Sep 19 11:54:36.695109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1644/3309] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:37.477574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:37.478228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:37.478624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:37.478755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:37.484623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:37.484808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:37.485113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:37.485247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:37.485550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:37.485679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:37.486246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:37.486368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:37.486698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:37.486828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:37.487121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:37.487281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:37.679994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:37.683295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:37.687775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:37.688932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8282a1ed-d7ce-479e-a31b-4c47953190ab tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215747 Sep 19 11:54:37.690082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1645/3310] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:37 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:37.694392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:37.696415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:37.697590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7c876e6e-69af-4078-97d3-04de5ac2dad7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.224565 Sep 19 11:54:37.698605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1666/3311] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:37.717327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:37.717941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:37.724227 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:37.724758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:37.725202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:37.726719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:37.727432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:37.727919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:37.791979 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:37.805366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-342b8022-e4b5-4dfc-89ae-8a3086b56f30 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087458 Sep 19 11:54:37.805366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1646/3312] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:38.713906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:38.714663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:38.721187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:38.721673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:38.722113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:38.722798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:38.723292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:38.723718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:38.725662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:38.726312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:38.733265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:38.733755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:38.734195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:38.734935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:38.735423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:38.735856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:38.917896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:38.921670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:38.926287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f6b2c321-1d2a-4293-bcbd-26b63672a60e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.217077 Sep 19 11:54:38.926864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1667/3313] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:38 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:38.930496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:38.931985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:38.932305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:38.932920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:38.933134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e4068bb8-900b-4a2c-83a2-42677aecc8f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.211508 Sep 19 11:54:38.933835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1647/3314] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:38.938849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:38.939367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:38.939807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:38.940502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:38.940961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:38.941385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:39.004361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:39.013305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4757e45-ac9f-46c6-9c7b-978e83c2d2bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085400 Sep 19 11:54:39.013883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1668/3315] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:39.952838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:39.953454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:39.958889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:39.959522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:39.960058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:39.960548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:39.960995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:39.962396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:39.962853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:39.963310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:39.966617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:39.967086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:39.967558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:39.968258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:39.968716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:39.969136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:40.155014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:40.162867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:40.163848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-acc46a53-1bee-40a7-b2e2-bcc03cfb412c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.214882 Sep 19 11:54:40.178973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1648/3316] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:39 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:40.178973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:40.178973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:40.179358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:40.179358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:40.179358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d6668c19-347b-4143-8e04-7a6d1905c66f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219298 Sep 19 11:54:40.179652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1669/3317] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:40.179739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:40.179739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:40.179739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:40.179739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:40.180647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:40.180647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:40.242395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:40.251326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4f6e598d-4c68-4672-aac1-5c60c15bb4e0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085907 Sep 19 11:54:40.251898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1649/3318] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:40 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:41.194586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:41.195222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:41.199894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:41.200517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:41.201867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:41.202352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:41.202786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:41.203551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:41.203994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:41.204419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:41.206769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:41.207388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:41.207800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:41.208498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:41.208965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:41.209412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:41.406598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:41.407637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:41.415734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-653a3d49-f2e8-418e-a7ea-213f0e0f6c2b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.224922 Sep 19 11:54:41.416318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1670/3319] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:41 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:41.416954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:41.418419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:41.419653 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b701e637-d889-4e98-8036-823b081a59be tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.223654 Sep 19 11:54:41.421236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:41.421847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:41.427983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:41.428465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:41.429120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:41.429819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:41.430307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:41.430732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:41.431542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1650/3320] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:41.490965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:41.499374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-31c0c589-4331-4210-a5e4-65da5efe0d5c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082040 Sep 19 11:54:41.499942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1671/3321] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:42.439193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:42.439757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:42.445194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:42.445800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:42.446203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:42.446690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:42.447130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:42.447845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:42.448308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:42.448734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:42.451860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:42.452340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:42.452771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:42.453451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:42.453928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:42.454348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:42.652783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:42.656106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:42.661430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0fc59eb9-68fe-4a3a-ad62-fa7955900605 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.226170 Sep 19 11:54:42.665111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:42.665435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1651/3322] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:42 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:42.666663 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:42.668008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-31d31671-6dad-4a48-afb9-f45413502547 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.226644 Sep 19 11:54:42.668554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1672/3323] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:42.670553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:42.671163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:42.677786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:42.678279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:42.678721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:42.679442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:42.680446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:42.680879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:42.740828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:42.749461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d6b632d5-3346-48fd-8fb0-89f1785bed6e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082833 Sep 19 11:54:42.750022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1652/3324] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:43.684721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:43.685352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:43.692153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:43.692643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:43.693132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:43.693830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:43.694283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:43.694528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:43.694962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:43.695260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:43.702326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:43.702803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:43.703266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:43.703949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:43.704397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:43.704816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:43.889395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:43.897620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-813016ee-9b28-44e7-a2d3-194fb77f550c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216951 Sep 19 11:54:43.911203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1673/3325] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:43 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:43.911553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:43.911844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:43.911844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:43.911844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:43.911844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:43.912221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:43.912334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:43.912459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:43.912459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:43.912459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:43.912882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:43.914196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f8e61b2b-ed4f-43d6-bbca-f25389370a32 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.224061 Sep 19 11:54:43.915147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1653/3326] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:43.976151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:43.984379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5ca781fc-fe07-4c75-8b19-67842acb6117 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085242 Sep 19 11:54:43.984956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1674/3327] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:44.923482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:44.924139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:44.930743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:44.931260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:44.931702 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:44.932394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:44.932847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:44.933271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:44.940521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:44.941126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:44.947617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:44.948102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:44.948540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:44.949219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:44.949665 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:44.950084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:45.133935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:45.137029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:45.142503 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-244e7d11-6042-4fcb-b485-27e205dbcb53 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.223964 Sep 19 11:54:45.144340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1654/3328] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:44 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:45.145786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:45.147323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:45.148503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4b671309-2cd7-4818-83d7-a5d7bdd46730 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.211872 Sep 19 11:54:45.150113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1675/3329] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:45.150251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:45.150849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:45.157090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:45.157571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:45.158014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:45.158703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:45.159162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:45.159881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:45.220602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:45.228849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7b359b82-3c6d-477c-bb85-a109f400d85a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083201 Sep 19 11:54:45.229410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1655/3330] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:46.168438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:46.169053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:46.174835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:46.175471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:46.175848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:46.176347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:46.176787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:46.177482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:46.177943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:46.178373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:46.181862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:46.182343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:46.182781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:46.183505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:46.183959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:46.184381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:46.188359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:46.372248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:46.375892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:46.380569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-654440cd-ade7-44fd-a67f-a73724aa5acf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216613 Sep 19 11:54:46.381145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1676/3331] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:46 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:46.384819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:46.385645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:46.386249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:46.386374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:46.387446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0cb74201-77f6-44a6-8099-608513c8ea38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216413 Sep 19 11:54:46.388180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1656/3332] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:46.392154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:46.392636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:46.393074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:46.393772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:46.394207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:46.394627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:46.456806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:46.465460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2b97be33-f0e3-46fa-be0d-03ae324268fd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083375 Sep 19 11:54:46.466023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1677/3333] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:47.404351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:47.404916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:47.411443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:47.411944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:47.412388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:47.413091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:47.413551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:47.414490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:47.418073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:47.418555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:47.424553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:47.425037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:47.425480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:47.426171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:47.426634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:47.427061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:47.609172 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:47.615899 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:47.617977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f14a1be1-f703-4288-83cc-57511efa07ea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.217153 Sep 19 11:54:47.618573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1657/3334] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:47 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:47.623054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:47.623693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:47.625442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:47.626887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:47.628082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-75c13cc3-1473-4420-b0c7-af4738d67c22 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215368 Sep 19 11:54:47.628962 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1678/3335] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:47.629462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:47.630007 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:47.630452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:47.631148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:47.631631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:47.632060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:47.700054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:47.708417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1cd5826a-da16-4d88-a607-aaf9ee1d80dd tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088893 Sep 19 11:54:47.709059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1658/3336] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:48.641619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:48.642239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:48.649324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:48.649815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:48.650254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:48.650997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:48.651488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:48.651921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:48.654593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:48.655347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:48.657538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=76 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:48.662785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:48.663439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:48.663941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:48.677405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:48.677405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:48.677405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:48.851020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:48.858113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:48.859417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c3c822be-26fe-4ec1-9eae-2083f393a909 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221702 Sep 19 11:54:48.860019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1679/3337] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:48 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:48.864466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:48.865077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:48.867239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:48.868696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:48.869872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4bb9ce89-3832-4f34-85ed-a86fb45b75d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219582 Sep 19 11:54:48.870610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1659/3338] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:48.870812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:48.871344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:48.871788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:48.872475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:48.872930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:48.873352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:48.939322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:48.948173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3247e822-8cae-4fe6-a2e1-c88c0728fe93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087201 Sep 19 11:54:48.948739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1680/3339] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:49.883283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:49.883894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:49.890352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:49.890828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:49.891286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:49.891967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:49.892419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:49.892838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:49.897938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:49.898677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:49.901016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=78 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:49.905878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:49.906527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:49.906972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:49.907704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:49.908240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:49.908673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:50.092080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:50.098898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:50.100328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a38224ae-70e7-4fa2-8bdc-14ac45dbc2d4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221481 Sep 19 11:54:50.100914 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1660/3340] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:49 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:50.105474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:50.106118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:50.108051 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:50.109515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:50.110687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6165b543-e6a4-4c2d-8220-4476b69eb00e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216991 Sep 19 11:54:50.111457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1681/3341] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:50.112481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:50.112844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:50.113287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:50.113988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:50.114446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:50.114876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:50.181879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:50.190147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4ab346bd-b200-41ba-ba77-0000a8a513bf tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088287 Sep 19 11:54:50.190728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1661/3342] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:51.126920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:51.127691 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:51.134781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:51.139793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:51.139793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:51.139793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:51.139793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:51.140309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:51.140409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:51.140409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:51.145579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:51.146055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:51.146490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:51.147286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:51.147739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:51.148160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:51.341597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:51.345535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:51.350237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-de84ab71-5f1e-4ed6-82ab-4f191149e067 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.227161 Sep 19 11:54:51.350828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1682/3343] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:51 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:51.355359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:51.356099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:51.356702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:51.356840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:51.357987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-83df5b39-8d92-40f7-af91-476c1b49e41f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.223382 Sep 19 11:54:51.358793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1662/3344] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:51.362928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:51.363447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:51.363886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:51.364578 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:51.365032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:51.365461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:51.384488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:54:51.429424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:51.437836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c3006e41-0fa6-4d60-b102-81e74e265d2b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085945 Sep 19 11:54:51.438413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1683/3345] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:52.374258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:52.374827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:52.381554 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:52.382042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:52.382473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:52.383185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:52.383657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:52.384051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:52.385074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:52.385679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:52.391969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:52.394566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:52.394566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:52.394566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:52.394566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:52.395024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:52.579093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:52.582335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:52.587699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-380be03a-103f-44ed-a0a8-b9df38dccf34 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.217864 Sep 19 11:54:52.588361 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1663/3346] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:52 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:52.591064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:52.592521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:52.592942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:52.593545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:52.593793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b406e87a-6d87-44d6-a557-7b18d5fc8f67 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.212823 Sep 19 11:54:52.594490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1684/3347] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:52.599510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:52.599998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:52.600431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:52.601115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:52.602108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:52.602539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:52.672975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:52.681878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7bbb2c71-0f8c-4151-b89f-52d9829ccb4c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.092517 Sep 19 11:54:52.682454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1664/3348] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:53.612273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:53.613022 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:53.620128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:53.620462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:53.620961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:53.621097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:53.621207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:53.621716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:53.622167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:53.622599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:53.627516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:53.627997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:53.628429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:53.629113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:53.629559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:53.629976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:53.830035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:53.833088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:53.841763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:53.846052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-759e0364-6076-4b8e-86cb-323a37c08ad1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.233894 Sep 19 11:54:53.846052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1685/3349] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:53 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:53.846330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:53.846330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0cd70f41-de19-46dd-9ea0-d1cfb84cf471 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.228616 Sep 19 11:54:53.846330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1665/3350] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:53.846764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:53.847704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:53.853994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:53.854469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:53.854894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:53.855600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:53.856048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:53.856467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:53.921835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:53.930374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-efa68abf-9c6e-4d1c-bdab-427da0bed978 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087069 Sep 19 11:54:53.934056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1686/3351] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:54.865785 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:54.866386 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:54.870218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:54.870820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:54.873130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:54.873625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:54.874068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:54.874771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:54.875257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:54.875727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:54.877470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:54.877955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:54.878382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:54.879062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:54.879540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:54.879964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:55.073430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:55.082927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:55.083132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:55.084548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:55.086402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2126badc-b67b-4d33-9bc3-7c82542f4587 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219610 Sep 19 11:54:55.089207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1687/3352] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:55.092689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:55.093487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:55.094000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-674a5209-b8c4-426d-81e7-d1a0438974bb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.231669 Sep 19 11:54:55.095349 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1666/3353] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:54 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:55.099876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:55.100358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:55.100787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:55.101594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:55.102042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:55.102460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:55.169342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:55.177494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-21b6a9e1-8b8c-4203-bf6a-ded61ccffee7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089434 Sep 19 11:54:55.178082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1688/3354] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:56.112327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:56.113637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:56.118353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:56.119098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:56.121339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:56.121835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:56.122280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:56.122990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:56.123483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:56.123912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:56.125685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:56.126169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:56.126602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:56.127319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:56.127805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:56.128228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:56.316955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:56.321503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:56.331824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:56.334475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:56.335092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-153ff6df-d0eb-4d1f-8533-89434eff737d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.220815 Sep 19 11:54:56.336078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1689/3355] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:56 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:54:56.336467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-66686974-5547-4f06-8f13-3d9417131a25 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.227839 Sep 19 11:54:56.337418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1667/3356] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:56.341254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:56.341856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:56.347570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:56.348053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:56.348490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:56.349174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:56.349631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:56.350058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:56.411228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:56.420129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-df5582a2-5760-44c8-8bb3-4a2a4529c4a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082748 Sep 19 11:54:56.420707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1690/3357] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:57.360060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:57.360672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:57.367904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:57.368136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:57.368680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:57.368844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:57.368997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:57.369417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:57.369875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:57.370303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:57.375030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:57.375543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:57.375969 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:57.376646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:57.377094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:57.377514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:57.566144 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:57.570881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:57.575037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eaf0674d-f238-4bb1-9e71-a56911d46f4e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.218743 Sep 19 11:54:57.576336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1668/3358] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:57 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:57.580269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:57.580910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:57.582628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:57.584201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:57.585915 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-de565490-9c3b-4c48-b492-0beac8599b53 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.221679 Sep 19 11:54:57.591260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1691/3359] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:54:57.591438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:57.591438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:57.591438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:57.591438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:57.591854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:57.591854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:57.651327 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:57.660143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9487e6b6-bed4-4ca6-8a9f-6e8546287182 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083350 Sep 19 11:54:57.660745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1669/3360] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:58.598028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:58.598645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:58.605754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:58.606247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:58.606694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:58.607414 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:58.607874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:58.608332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:58.612189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:58.612803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:58.619150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:58.619662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:58.620102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:58.620794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:58.621246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:58.621670 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:58.792251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:58.800521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-009ca044-2e8c-482b-871f-3f208ec74de0 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.206419 Sep 19 11:54:58.801486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1692/3361] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:58 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:58.805648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:58.806253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:58.812063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:58.812560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:58.812998 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:58.813907 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:58.814365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:58.814797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:58.817089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:58.825908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:58.827388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:58.828723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9da233e1-a819-4737-b399-8af286840444 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220426 Sep 19 11:54:58.829290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1670/3362] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:54:58.878167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:54:58.886614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-99284c43-4f02-4406-99d0-cc0b89f30c47 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084552 Sep 19 11:54:58.887190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1693/3363] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:54:59.825457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:59.826103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:59.832703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:59.833187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:59.833636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:59.834323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:59.834780 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:59.835323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:59.855627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:54:59.856255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:54:59.862611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:59.863085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:59.863552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:54:59.864240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:54:59.864694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:54:59.865113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:00.026861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:00.035781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a21448b8-b070-466e-9daa-af97b698ce05 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.214209 Sep 19 11:55:00.036373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1671/3364] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:54:59 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:00.041112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:00.041736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:00.045072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:00.049570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:00.050325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:00.050984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:00.051930 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:00.052513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:00.053185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:00.054800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:00.056470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:00.057674 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b212a452-401b-4b40-9b44-43ad498cd429 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.205994 Sep 19 11:55:00.059790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1694/3365] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:54:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:00.120849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:00.124260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:00.129246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4d2b4665-db70-41ab-a572-51c08e705604 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.091911 Sep 19 11:55:00.129818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1672/3366] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:01.070686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:01.071332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:01.077996 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:01.078480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:01.080325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:01.080325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:01.080325 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:01.080678 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:01.085358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:01.085980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:01.093082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:01.093597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:01.094040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:01.094739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:01.095220 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:01.095655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:01.273087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:01.281522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e32e6b6d-5ee8-4a8a-b0cb-ab79d2f5a634 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215382 Sep 19 11:55:01.284410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1695/3367] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:01 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:01.285204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:01.287760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:01.289132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:01.295256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:01.295674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:01.295957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:01.296400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:01.297096 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:01.297282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:01.297554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:01.297981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:01.298713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7faa4d0d-f9e7-44cd-a8dc-eaef8eb159b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.217291 Sep 19 11:55:01.299300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1673/3368] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:01.365202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:01.374036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-88c0ded2-b3f9-4666-9f5f-c41576c25a25 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090980 Sep 19 11:55:01.374586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1696/3369] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:02.306108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:02.306710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:02.313188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:02.313674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:02.314108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:02.314795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:02.315272 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:02.315708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:02.325327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:02.326195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:02.332274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:02.332757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:02.333192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:02.333985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:02.334335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:02.334760 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:02.497827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:02.506118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b1d000ae-ae1c-4d4e-97bc-f0000e00693c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.204439 Sep 19 11:55:02.506793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1674/3370] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:02 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:02.511378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:02.511991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:02.517919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:02.518416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:02.518858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:02.519368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:02.519581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:02.520046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:02.520475 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:02.529162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:02.530694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:02.532006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b577a4b6-a650-4b23-9b8a-2628ea1c1bf6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.210638 Sep 19 11:55:02.532646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1697/3371] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:02.584989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:02.593835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-00d155c3-c1de-4b3a-ab73-339f0e1369da tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086064 Sep 19 11:55:02.594405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1675/3372] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:03.528628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:03.529235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:03.536445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:03.536924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:03.537356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:03.538036 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:03.538976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:03.539422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:03.558483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:03.559223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:03.565643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:03.566127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:03.566566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:03.567283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:03.567746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:03.568173 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:03.737491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:03.746039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:03.747541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e7d43e7e-91cc-423a-af74-84675a3d5320 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.222671 Sep 19 11:55:03.748130 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1698/3373] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:03 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:03.752931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:03.753526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:03.755149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:03.756623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:03.757830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a50ec63a-d480-4508-9116-5037336bcc6a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.203871 Sep 19 11:55:03.758391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1676/3374] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:03.759780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:03.760265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:03.760695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:03.761381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:03.761878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:03.762467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:03.828167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:03.837302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a533fcc6-138e-423c-9b95-c6e249fd42e8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088216 Sep 19 11:55:03.837885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1699/3375] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:04.771625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:04.772230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:04.779713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:04.780201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:04.780678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:04.781373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:04.781830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:04.782253 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:04.782797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:04.783436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:04.790145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:04.790635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:04.791077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:04.791818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:04.792275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:04.792716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:04.796853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:04.976284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:04.980068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:04.985107 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1cca8565-109d-45c5-89d4-b071e450e6ae tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.217311 Sep 19 11:55:04.985689 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1677/3376] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:04 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:04.990164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:04.990768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:04.995631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:04.997180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:04.997626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:04.998182 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:04.998596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0bb4fa3f-0ae4-4e17-b919-913371b3dacc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219683 Sep 19 11:55:04.998718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:04.999421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1700/3377] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:04.999555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:04.999800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:05.000284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:05.061141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:05.070369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7b9fcf37-3480-4dfa-8e0d-fd408aceb189 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083678 Sep 19 11:55:05.070942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1678/3378] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:04 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:06.009994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:06.010713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:06.017136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:06.017617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:06.018056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:06.018838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:06.019329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:06.019758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:06.024583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:06.025214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:06.031678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:06.032161 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:06.032597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:06.033291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:06.033752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:06.034439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:06.224658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:06.231796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:06.232866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-332f039b-6e93-4197-958f-ee4439d111cd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.227214 Sep 19 11:55:06.233447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1701/3379] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:06 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:06.238863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:06.239492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:06.240763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:06.242719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:06.243927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ea2275d0-cbdf-45ed-82ff-fedd37b479f8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.223857 Sep 19 11:55:06.244645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1679/3380] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:06.245904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:06.246392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:06.246830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:06.247558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:06.248014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:06.248437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:06.309097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:06.317303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cbc5b6f5-cde0-438e-9c09-b0e4d27bf075 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082646 Sep 19 11:55:06.317872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1702/3381] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:07.255938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:07.256561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:07.263772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:07.264260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:07.264710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:07.265404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:07.265902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:07.266481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:07.269766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:07.270381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:07.277443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:07.277929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:07.278368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:07.279065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:07.279558 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:07.279985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:07.463342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:07.467359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:07.471766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d3f1dada-8320-4b22-a4d6-6f6c46e6eab7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.219664 Sep 19 11:55:07.472346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1680/3382] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:07 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:07.476223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:07.476918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:07.477524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:07.477662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:07.478855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3062e91b-81da-496a-8af4-d876aebb4ba0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.213083 Sep 19 11:55:07.479628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1703/3383] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:07.483435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:07.483927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:07.484376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:07.485064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:07.485521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:07.485950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:07.546625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:07.555403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2aa63945-9585-4644-8c02-7b0ab7a39796 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082069 Sep 19 11:55:07.556043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1681/3384] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:08.495601 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:08.496160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:08.502790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:08.503311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:08.503756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:08.504454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:08.504660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:08.505121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:08.505327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:08.505437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:08.512097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:08.512577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:08.513015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:08.513709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:08.514169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:08.514594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:08.704314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:08.707746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:08.713453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3a9124b3-8e1f-48cd-a5b3-80b16c58d9fe tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221836 Sep 19 11:55:08.714116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1704/3385] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:08 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:08.717202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:08.718648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:08.718812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:08.719387 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:08.719854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b528cb7b-5f15-49bd-8fa6-def8f28d77fe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219279 Sep 19 11:55:08.720622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1682/3386] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:08.725705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:08.726193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:08.726631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:08.727352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:08.727810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:08.728236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:08.796459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:08.802570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8d7cd67d-b7cc-42ee-bce2-b3f0171cb298 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087501 Sep 19 11:55:08.803162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1705/3387] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:09.737533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:09.738160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:09.744714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:09.745206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:09.745568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:09.745991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:09.746173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:09.746326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:09.746787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:09.747243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:09.752523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:09.752995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:09.753426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:09.754103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:09.754551 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:09.754972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:10.178358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:10.181419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:10.187192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-db68660c-c406-4539-9f28-d04b6c23d52d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.453454 Sep 19 11:55:10.187800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1683/3388] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:09 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:10.190453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:10.191941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:10.192509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:10.193113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1dc8f883-1860-4e7c-8af6-52c1ae880b5d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.451393 Sep 19 11:55:10.193251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:10.196303 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1706/3389] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:10.200752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:10.201197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:10.201634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:10.202326 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:10.202778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:10.203221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:10.263139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:10.271447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f1fa33b0-23e5-4ecf-a35c-4dc4fa6ed50e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082665 Sep 19 11:55:10.272018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1684/3390] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:11.212090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:11.212698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:11.219591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:11.219938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:11.220390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:11.220501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:11.220614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:11.221095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:11.221548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:11.222111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:11.226996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:11.227523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:11.227963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:11.228664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:11.229121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:11.229551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:11.422188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:11.425973 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:11.431494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:11.432999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:11.434176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-09c60d7b-be47-4fbd-a2d0-cd8fcc9ac740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.218628 Sep 19 11:55:11.434940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1685/3391] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:11.435073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e86cdce2-d784-4b06-ac74-3b25ae46b190 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.227274 Sep 19 11:55:11.435516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1707/3392] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:11 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:11.439188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:11.439803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:11.446538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:11.447034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:11.447572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:11.448486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:11.448730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:11.449159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:11.510602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:11.518840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-725e44a5-5494-4a03-be98-1bac00ccb3ab tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083102 Sep 19 11:55:11.519433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1686/3393] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:12.459397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:12.460625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:12.461775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:12.462392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:12.467072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:12.467592 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:12.468060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:12.468756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:12.468893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:12.469209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:12.469336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:12.469634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:12.469771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:12.470364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:12.470854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:12.471310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:12.662383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:12.670937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:12.671346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-51d132d7-3c7d-456b-bbc8-706468466e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215885 Sep 19 11:55:12.671945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1708/3394] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:12 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:12.676811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:12.677416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:12.681079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:12.682540 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:12.684112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-12d691c5-955d-4e2b-8662-b75987e638b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.226895 Sep 19 11:55:12.684370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:12.685004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1687/3395] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:12.685244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:12.685735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:12.686577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:12.687163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:12.687763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:12.754494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:12.763298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-13ea360c-1358-4723-aba9-9def2b016f14 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090366 Sep 19 11:55:12.763968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1709/3396] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:13.699131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:13.699633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:13.706031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:13.719478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:13.719478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:13.719478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:13.719478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:13.719952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:13.720066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:13.720066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:13.720066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:13.720066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:13.721245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:13.721245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:13.721245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:13.721245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:13.901309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:13.908362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:13.909947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1c704414-def6-4ffa-8b9e-49a5d78ed4ef tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215705 Sep 19 11:55:13.910684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1688/3397] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:13 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:13.916022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:13.916738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:13.918393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:13.919871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:13.921052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dcd8bf30-a2f5-4cc5-8ff1-1afa325231c3 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.215305 Sep 19 11:55:13.921602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1710/3398] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:13.931093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:13.931648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:13.932095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:13.932818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:13.933373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:13.933804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:13.952784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:13.997625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:14.006103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-739ba69c-e914-4a19-a28e-99be0316302e tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.094241 Sep 19 11:55:14.007235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1689/3399] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:14.934049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:14.934685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:14.941307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:14.941791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:14.942230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:14.942928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:14.943419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:14.943854 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:14.946870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:14.947519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:14.954126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:14.954615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:14.955060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:14.955787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:14.956309 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:14.956769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:15.140614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:15.148211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:15.149109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c0bf21dd-b407-4236-bb29-36c0ef7eff7d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.218903 Sep 19 11:55:15.149701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1711/3400] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:14 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:15.154373 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:15.154980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:15.157228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:15.158927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:15.160109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dbd1d4c4-e879-445f-a7f3-bc135a73220e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.217672 Sep 19 11:55:15.160878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1690/3401] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:15.161173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:15.161662 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:15.162101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:15.163049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:15.163540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:15.164011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:15.227454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:15.235788 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-191f5dc1-e164-4570-a856-69a01168b2e6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085140 Sep 19 11:55:15.236362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1712/3402] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:16.173048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:16.173679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:16.175700 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:55:16.175854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:55:16.176832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:55:16.176954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:55:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 (ip 10.222.0.78) !!! Sep 19 11:55:16.186001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:16.186204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:16.186644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:16.186756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:16.187009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:16.188228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:16.188709 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:16.189137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:16.194280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:16.194766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:16.195482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:16.196443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:16.196897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:16.197326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:16.372222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:16.381026 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:16.382457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:16.383643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fda13106-0364-4c6c-8a2e-1cd1675a7c68 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.201401 Sep 19 11:55:16.384201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1713/3403] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:16 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:16.388604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:16.389202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:16.395240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:16.395732 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:16.396165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:16.396855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:16.397304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:16.397722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:16.421260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:16.430157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a62ae040-70d6-4c92-b72e-6da6e76b7921 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.261051 Sep 19 11:55:16.430747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1691/3404] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:16 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:16.460472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:16.468538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a4f068d-2349-4f52-ac88-398f06348d29 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083408 Sep 19 11:55:16.469223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1714/3405] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:17.410300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:17.410888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:17.416939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:17.417447 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:17.417870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:17.418562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:17.419022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:17.419488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:17.452543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:17.453133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:17.459283 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:17.459816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:17.460257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:17.460938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:17.461428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:17.461850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:17.599516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:17.608560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:17.610169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:17.611539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-16ed5a89-2974-4b22-8ef7-1e7e349da737 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.205683 Sep 19 11:55:17.612402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1692/3406] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:17 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:17.617178 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:17.617818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:17.623779 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:17.624259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:17.624694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:17.625385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:17.625845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:17.626273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:17.629710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:17.638603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ce895673-886a-4b7f-af8b-31c8640ffb04 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.190069 Sep 19 11:55:17.639184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1715/3407] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:17 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:55:17.688199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:17.696559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a5c155df-8341-4560-b450-586bf7825aa6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083428 Sep 19 11:55:17.697141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1693/3408] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:17 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:18.638223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:18.638847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:18.645351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:18.645827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:18.646294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:18.646976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:18.648072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:18.648496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:18.661966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:18.662581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:18.668926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:18.669428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:18.669862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:18.670615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:18.671067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:18.671521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:18.840273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:18.843712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:18.849348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:18.850843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:18.852142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3a2e1153-038a-49bf-82e5-ad02a2390659 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.217750 Sep 19 11:55:18.868077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1716/3409] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:18 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:18.868324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:18.868456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:18.868456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:18.868674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-90553ca1-6c6d-4b4e-beba-e55be6faadea tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.205468 Sep 19 11:55:18.868777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:18.868777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:18.868972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1694/3410] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:18 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:55:18.869078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:18.869078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:18.869078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:18.869078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:18.930346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:18.938540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ca940c18-cdb1-4fe7-b11e-4554bf1b7d13 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084803 Sep 19 11:55:18.939112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1717/3411] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:18 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:19.880152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:19.880762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:19.883811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=72 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:19.887440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:19.888072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:19.888510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:19.889026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:19.889464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:19.890155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:19.890665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:19.891035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:19.894600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:19.902940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:19.902940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:19.902940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:19.902940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:19.903393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:20.085587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:20.088758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:20.094528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:20.096006 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:20.097136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f1a1131f-72d6-49b3-aaad-2731e57a050c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.213564 Sep 19 11:55:20.097284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d0cb6e72-4d1c-4694-9df0-8b16369fe4c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220971 Sep 19 11:55:20.097904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1718/3412] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:19 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:55:20.102763 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:20.103149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1695/3413] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:19 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:20.103399 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:20.105113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=76 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:20.109840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:20.114485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:20.114485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:20.114485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:20.114485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:20.114897 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:20.176577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:20.185349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5e64b456-a707-45cc-bcf7-b6bc5145e464 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086699 Sep 19 11:55:20.185923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1719/3414] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:20 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:21.121177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:21.121874 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:21.128757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:21.129239 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:21.129360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:21.129792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:21.129931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:21.130359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:21.130817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:21.131278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:21.136680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:21.137614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:21.137614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:21.138278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:21.138720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:21.139150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:21.334367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:21.341486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:21.343193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8f2c6dd9-4acc-4fa1-a12c-7eb2e94e01a9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.225898 Sep 19 11:55:21.343782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1696/3415] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:21 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:21.348248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:21.348854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:21.351298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:21.352743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:21.353944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-77b3dd51-7ad1-4a5c-810e-0e98cfcd3aee tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.228791 Sep 19 11:55:21.354684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1720/3416] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:21 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:21.354826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:21.355271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:21.355714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:21.356415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:21.356876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:21.357307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:21.420316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:21.429134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3c1b4260-5cb5-44bf-ad48-878b9398b759 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083746 Sep 19 11:55:21.429697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1697/3417] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:21 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:22.373525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:22.374139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:22.379599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:22.380204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:22.380731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:22.381712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:22.382160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:22.382848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:22.383342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:22.383766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:22.387544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:22.388318 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:22.388766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:22.389504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:22.389996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:22.390429 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:22.577617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:22.584457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:22.586252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9a2ab596-6464-433f-ad77-67c2394bce02 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216743 Sep 19 11:55:22.586919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1721/3418] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:22 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:22.591501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:22.592205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:22.593203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:22.594639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:22.595835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6b4c97b9-fecb-4b63-9c27-471879c67bf4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220136 Sep 19 11:55:22.596568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1698/3419] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:22 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:22.598292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:22.598864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:22.599410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:22.600208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:22.600735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:22.601240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:22.661889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:22.670075 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-041d4344-029f-4ecd-8f6a-4d9c6c22cc86 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082119 Sep 19 11:55:22.670643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1722/3420] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:22 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:23.610014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:23.613098 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:23.620001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:23.620483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:23.620920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:23.621623 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:23.622027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:23.622476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:23.622476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:23.622668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:23.631100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:23.632002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:23.632454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:23.633200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:23.633659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:23.634092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:23.832159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:23.839016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:23.842429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:23.843900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:23.845277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b99d19ab-874f-425b-9cc9-17c97647ea1a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.227799 Sep 19 11:55:23.845866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1723/3421] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:23 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:23.847738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-43de24c0-659a-447b-853b-a732325739c9 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.241502 Sep 19 11:55:23.848313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1699/3422] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:23 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:23.851519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:23.852358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:23.858640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:23.859455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:23.860188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:23.861076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:23.861723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:23.862332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:23.928843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:23.937019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b49c59f3-b814-4664-99ea-d99c30348c8b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090044 Sep 19 11:55:23.937593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1724/3423] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:23 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:24.871899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:24.872508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:24.872637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:24.873208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:24.879104 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:24.879603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:24.879762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:24.880036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:24.880172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:24.880513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:24.880729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:24.881779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:24.881911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:24.882209 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:24.882329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:24.882655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:25.092275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:25.093458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:25.097722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49c50fe7-bbd6-44ab-8e1f-7da85130eb2d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.229625 Sep 19 11:55:25.098301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1700/3424] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:24 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:25.102442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:25.102910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:25.103544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:25.103914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:25.105095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c69d812f-7797-4249-891a-794e726f2b27 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.236315 Sep 19 11:55:25.106020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1725/3425] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:24 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:25.117629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:25.117901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:25.118334 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:25.119053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:25.119534 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:25.119959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:25.184399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:25.192556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-04f0da7f-627a-406f-8c3b-119bae37dbfa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.093323 Sep 19 11:55:25.193115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1701/3426] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:25 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:26.121745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:26.122357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:26.128991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.129477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.129919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.130621 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.131105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.131287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:26.131727 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.131832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:26.139379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.139860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.140321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.141045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.141496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.141923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.324249 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:26.332825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-83689e80-ef4e-4b19-aee1-d3afa4fea09c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.214872 Sep 19 11:55:26.333629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1726/3427] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:26 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:26.338699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:26.339344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:26.339968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:26.346091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.346869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.347339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.348653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:26.348653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:26.349137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:26.358954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:26.360745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:26.362010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-31a5b749-dd33-4cfc-8736-bd802e0597b2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.234840 Sep 19 11:55:26.362589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1702/3428] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:26 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:26.411770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:26.421122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a3e7c3e2-ba8f-456b-aef4-5a32545282ac tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.086626 Sep 19 11:55:26.421701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1727/3429] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:26 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:27.367271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:27.367875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:27.374535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.375013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.375479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.376204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.376646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.377068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.388223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:27.388957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:27.396146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.396647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.397080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.397780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.398239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.398689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.575276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:27.582121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:27.583628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7bcfc989-7ac7-4992-9845-c31ee42ad7bd tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.220657 Sep 19 11:55:27.584222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1703/3430] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:27 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:27.588621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:27.589225 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:27.591982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:27.593415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:27.594582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e8192bb2-fbe3-48b5-aafb-a18d97d174b1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.210387 Sep 19 11:55:27.595391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.595535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1728/3431] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:27 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:27.595644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.596091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.596774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:27.597222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:27.597704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:27.658523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:27.667402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c628972c-913a-471d-8c3e-5327e9eb4266 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082187 Sep 19 11:55:27.668003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1704/3432] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:27 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:28.612968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:28.613576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:28.620238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:28.620533 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:28.620955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:28.621059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:28.621161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:28.621823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:28.622275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:28.622700 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:28.627488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:28.627977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:28.628421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:28.629120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:28.629582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:28.630012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:28.816589 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:28.823758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:28.825082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-252ef80a-3868-4678-8987-848003b496c7 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215978 Sep 19 11:55:28.825657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1729/3433] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:28 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:28.830242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:28.830847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:28.833061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:28.835043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:28.836264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b1e145b8-3a2c-41f9-9410-5a2dc3a63a63 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219709 Sep 19 11:55:28.836817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1705/3434] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:28 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:28.837430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:28.838108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:28.838729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:28.839632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:28.840265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:28.840833 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:28.902006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:28.910724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5d14e00e-cea1-4e7b-91ee-784ac907991a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084127 Sep 19 11:55:28.911319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1730/3435] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:28 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:29.848695 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:29.849329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:29.856245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:29.856722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:29.857154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:29.857836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:29.858291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:29.858711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:29.862757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:29.863516 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:29.864138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:29.871350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:29.871841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:29.876097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:29.876097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:29.876097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:29.876097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:30.057783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:30.061809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:30.066049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-95ad8524-a15a-42db-b18a-f9c453482461 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221173 Sep 19 11:55:30.066636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1706/3436] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:29 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:30.070712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:30.071068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:30.071909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:30.072185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:30.073344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e2feff80-1f6c-4ce7-aaf3-875c3783761d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.214249 Sep 19 11:55:30.078262 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:30.078794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:30.079317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:30.080269 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:30.080808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:30.081322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:30.083820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1731/3437] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:29 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:30.144593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:30.153267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-12b9bddf-18f1-4ceb-b227-cf24f4dcf665 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085680 Sep 19 11:55:30.153833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1707/3438] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:30 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:31.090050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:31.090657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:31.097178 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:31.097659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:31.098092 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:31.098295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:31.098765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:31.098899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:31.099238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:31.100291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:31.106517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:31.107003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:31.107601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:31.108296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:31.108749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:31.109177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:31.304142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:31.307426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:31.312942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-da1cd160-6cb3-4668-9b89-51075eb28b4b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.226823 Sep 19 11:55:31.313536 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1732/3439] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:31 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:31.318247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:31.319065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:31.319400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:31.320571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:31.321910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-96b6749b-909c-46b4-a1e7-0bc900038dcd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.227545 Sep 19 11:55:31.322712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1708/3440] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:31 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:31.325699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:31.326269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:31.326775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:31.327752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:31.328279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:31.328936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:31.348541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:31.392699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:31.402570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-faf4241e-6a87-44c6-9bc5-a69c670796a4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087957 Sep 19 11:55:31.404318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1733/3441] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:31 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:32.337354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:32.337947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:32.344578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:32.345069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:32.345509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:32.346211 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:32.346665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:32.347092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:32.348576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:32.349188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:32.356816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:32.357305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:32.357736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:32.358424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:32.358880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:32.359332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:32.545490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:32.552537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:32.554101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-97dc06a6-3297-42c9-b5f0-33ce78a3434e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221066 Sep 19 11:55:32.554687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1709/3442] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:32 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:32.559613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:32.560214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:32.561330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:32.563451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:32.564629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6ace818a-aac8-4f9f-8ce3-a300afe09cfe tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219922 Sep 19 11:55:32.565403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1734/3443] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:32 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:32.565998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:32.566496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:32.566934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:32.567675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:32.568137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:32.568564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:32.628910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:32.637012 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a85bd96-0aff-423e-b24b-0023e8e61865 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.080890 Sep 19 11:55:32.637588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1710/3444] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:32 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:33.582922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:33.583547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:33.590199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:33.590681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:33.590831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:33.591145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:33.591609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:33.592330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:33.592781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:33.593202 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:33.597221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:33.597706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:33.598147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:33.598839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:33.599324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:33.600074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:33.789625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:33.792857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:33.799224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d08fd0b7-9d4a-499a-875e-c2a44ace3afa tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.219870 Sep 19 11:55:33.799826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1735/3445] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:33 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:33.801676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:33.803775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:33.805041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:33.805185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e34cceca-e643-495f-b408-9ef9f04e9187 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.218759 Sep 19 11:55:33.805815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1711/3446] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:33 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:33.805938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:33.811739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:33.812226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:33.812672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:33.813398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:33.813839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:33.814497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:33.876905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:33.885976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-72a0aede-7bd1-4173-9499-876984760733 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085194 Sep 19 11:55:33.886548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1736/3447] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:33 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:34.825786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:34.826404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:34.831027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:34.831670 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:34.833125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:34.833610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:34.834045 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:34.834740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:34.835232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:34.835790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:34.837932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:34.838411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:34.838839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:34.839540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:34.839991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:34.840415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:35.031676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:35.035939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:35.041427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-44e5740a-2f21-4ea8-bc47-3c0d4219006a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.219454 Sep 19 11:55:35.042013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1712/3448] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:34 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:35.045610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:35.046589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:35.047055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:35.047233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:35.048273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e271035-0231-444f-b4dc-899d51e366f0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.221054 Sep 19 11:55:35.048995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1737/3449] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:34 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:35.054886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:35.055555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:35.055818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:35.056549 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:35.057014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:35.057463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:35.119916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:35.128206 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-399f0521-02f0-4883-86c4-a101ee38ba4a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085229 Sep 19 11:55:35.128772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1713/3450] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:35 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:36.065884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:36.066491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:36.073654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:36.074132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:36.074564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:36.075291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:36.075778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:36.076204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:36.077981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:36.078607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:36.085259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:36.085667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:36.086112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:36.086819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:36.087348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:36.087775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:36.272647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:36.276722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:36.281198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5503f5d2-db23-46ef-9843-703205dda71e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.219138 Sep 19 11:55:36.281779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1738/3451] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:36 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:36.285708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:36.286576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:36.287196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:36.287360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:36.288375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6bdc9aef-0061-4cc1-bf94-95582ccd00e0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.214420 Sep 19 11:55:36.289103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1714/3452] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:36 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:36.292993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:36.293473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:36.293919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:36.294721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:36.295200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:36.295630 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:36.361481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:36.370204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8515a521-0f53-4ecd-9ac7-16679af4388c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087480 Sep 19 11:55:36.370770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1739/3453] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:36 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:37.304544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:37.306370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:37.311909 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:37.312394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:37.312829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:37.313523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:37.313985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:37.314413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:37.315635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:37.316251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:37.323305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:37.323849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:37.324288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:37.325268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:37.325723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:37.326251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:37.499799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:37.508678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5c001b08-7d26-4635-b6c9-741cc69a9f9a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.208090 Sep 19 11:55:37.509254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1715/3454] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:37 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:37.513694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:37.514298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:37.520054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:37.520538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:37.520976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:37.522271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:37.522734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:37.523143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:37.526749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:37.535985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:37.537447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:37.538624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4581fc55-5154-4701-9623-836623736132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.228623 Sep 19 11:55:37.539396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1740/3455] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:37 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:37.586665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:37.594858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a7e7c58-52a8-4580-958f-690053a0b61b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084649 Sep 19 11:55:37.595455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1716/3456] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:37 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:38.532454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:38.533365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:38.539855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:38.540340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:38.540778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:38.541467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:38.541926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:38.542358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:38.564928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:38.565581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:38.572796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:38.573342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:38.573789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:38.574487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:38.574943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:38.575400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:38.739388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:38.750652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:38.750933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f4274bbc-0148-4bb5-b9a4-23c16c2f921f tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.222365 Sep 19 11:55:38.751576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1741/3457] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:38 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:38.756681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:38.757405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:38.760367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:38.761915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:38.763163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b378dd0d-5781-4dcd-8eac-7c42d342c210 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.202233 Sep 19 11:55:38.763585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:38.767220 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:38.767384 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1717/3458] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:38 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:38.767492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:38.767492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:38.767492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:38.767492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:38.827253 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:38.835980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cbefc3b7-4083-4ac3-b969-bf2427147702 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083444 Sep 19 11:55:38.836548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1742/3459] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:38 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:39.774042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:39.774641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:39.781076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:39.781546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:39.781977 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:39.782918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:39.783406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:39.783829 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:39.790438 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:39.791042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:39.797468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:39.797952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:39.798389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:39.799084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:39.799564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:39.799994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:39.982768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:39.986771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:39.991329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-38244bf7-ff63-44bd-befb-ee49839c565a tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221141 Sep 19 11:55:39.991915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1718/3460] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:39 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:39.995754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:39.996421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:39.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:39.997198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:39.998365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-36e4c65c-01ed-4639-bb81-55d59b13b4cf tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.212356 Sep 19 11:55:39.999079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1743/3461] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:39 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:40.002996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:40.003625 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:40.003976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:40.004849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:40.005862 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:40.006357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:40.072150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:40.080453 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9f6f1354-0afb-41ca-a16b-2a9997b963a6 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087577 Sep 19 11:55:40.081020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1719/3462] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:39 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:41.015933 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:41.016715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:41.022582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:41.023226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.023371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:41.023720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.024167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.024865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.025319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.025748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.029674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.030163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.030606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.031699 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.032160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.032927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.236323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:41.239483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:41.245520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0cac58a4-1267-476a-ba17-604b45d5af8b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.233497 Sep 19 11:55:41.246181 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1744/3463] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:41 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:41.249085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:41.250515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:41.250792 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:41.251486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:41.251826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-245b8ef6-25f5-437d-8558-56a34fc112e5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.233091 Sep 19 11:55:41.252567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1720/3464] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:41 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:41.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.258341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.258841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.259632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:41.260156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:41.260650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:41.323431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:41.331770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1a71b813-3ebe-4498-ad91-8216f60a0972 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084569 Sep 19 11:55:41.332408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1745/3465] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:41 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:42.269148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:42.269781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:42.276381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:42.276867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:42.277332 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:42.277480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:42.277956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:42.278068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:42.278490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:42.278903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:42.284544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:42.285031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:42.285470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:42.286158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:42.286616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:42.287042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:42.471517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:42.473912 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:42.480278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f15fc997-8096-415d-93f1-31da2edd67e8 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215016 Sep 19 11:55:42.480855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1721/3466] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:42 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:42.483045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:42.484504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:42.485266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:42.485795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2c523985-4043-4b66-8d38-ed0d571cabe2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.212396 Sep 19 11:55:42.485937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:42.486569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1746/3467] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:42 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:42.492237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:42.492722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:42.493158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:42.493852 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:42.494292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:42.494713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:42.555350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:42.558662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:42.563703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-87df55f3-2cd2-43a9-b174-4ec09ee622ef tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.081913 Sep 19 11:55:42.564276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1722/3468] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:42 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:43.504110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:43.504715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:43.511748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:43.512345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:43.512463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:43.512713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:43.513167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:43.513873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:43.514333 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:43.514766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:43.520254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:43.520782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:43.521847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:43.522550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:43.523037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:43.523502 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:43.947053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:43.950282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:43.955939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e15425d0-8766-4221-bd21-8ad3083011f4 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.455657 Sep 19 11:55:43.956520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1747/3469] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:43 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:43.959449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:43.960903 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:43.961190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:43.961783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:43.962244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-802796e4-9267-4328-8738-f91a3b7a4058 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.454406 Sep 19 11:55:43.962999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1723/3470] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:43 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:43.967769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:43.968250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:43.968683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:43.969363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:43.969937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:43.970359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:44.032819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:44.042275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-57541275-9f35-40b1-8175-aef72cec509f tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084734 Sep 19 11:55:44.042846 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1748/3471] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:43 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:44.982195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:44.983035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:44.988396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:44.989006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:44.991983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:44.992726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:44.993190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:44.994018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:44.994879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:44.995392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:44.995560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:44.995876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:44.996314 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:44.997001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:44.997455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:44.997879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:45.186359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:45.193757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:45.195728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:45.197221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:45.198396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e180bf3b-cd05-4234-86ab-2bc8817646fb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.213922 Sep 19 11:55:45.198964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1749/3472] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:44 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:45.202037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dece3bdd-1457-4eb5-b402-b77a831cad2c tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.224355 Sep 19 11:55:45.202759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1724/3473] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:44 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:45.203602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:45.204216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:45.210135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:45.210790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:45.211264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:45.211961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:45.212418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:45.212847 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:45.216826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:45.273165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:45.281328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-26b496d3-f957-4904-9fd4-63eff9b622c8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.081398 Sep 19 11:55:45.281895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1750/3474] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:45 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:46.222956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:46.223574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:46.224945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:46.225554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:46.230090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:46.230583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:46.231031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:46.231757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:46.231993 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:46.232213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:46.232473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:46.232640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:46.232909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:46.233594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:46.234043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:46.234471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:46.425479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:46.428566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:46.434406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:46.435984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:46.436778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-931cf7b5-bb93-43ab-8c46-832c8f07fb27 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.215578 Sep 19 11:55:46.437321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4b38833e-bd92-47a1-98eb-a78ee532bc35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.218187 Sep 19 11:55:46.437463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1751/3475] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:46 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:46.438122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1725/3476] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:46 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:46.441982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:46.442583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:46.448848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:46.449334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:46.449776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:46.450465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:46.450925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:46.451384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:46.513453 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:46.522184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c7c6efd6-5ebc-4265-80f8-57011c27c98d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083890 Sep 19 11:55:46.522757 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1752/3477] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:46 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:47.461018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:47.461580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:47.463673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:47.464284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:47.468027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:47.468578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:47.469054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:47.469778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:47.470214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:47.470390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:47.470633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:47.470794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:47.471191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:47.471887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:47.472342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:47.472773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:47.664868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:47.668549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:47.673319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a8b2a3f-28b4-4f01-8e6e-7710c34ac852 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216771 Sep 19 11:55:47.673900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1726/3478] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:47 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:47.677467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:47.687679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:47.687818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:47.687951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:47.688055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8b34036e-080d-46d3-a498-b4bb4dddc02d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220357 Sep 19 11:55:47.688055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1753/3479] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:47 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:47.688243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:47.688243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:47.688243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:47.688243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:47.688582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:47.688582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:47.750493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:47.759430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8b577add-aaec-4a2d-8da6-fe83f8e0da93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084537 Sep 19 11:55:47.760004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1727/3480] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:47 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:48.710008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:48.710639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:48.711728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:48.712333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:48.717443 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:48.717936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:48.718383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:48.718704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:48.719086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:48.719295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:48.719571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:48.719693 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:48.720002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:48.720284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:48.720728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:48.721149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:48.902511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:48.910977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bb746193-d832-4b61-9cf2-6d87fbd7e159 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.205264 Sep 19 11:55:48.911652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1754/3481] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:48 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:48.916476 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:48.917825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:48.919775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:48.923902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:48.924389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:48.924830 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:48.925525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:48.925982 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:48.926410 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:48.929624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:48.931219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:48.932498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49823cf5-583b-440f-bd6f-a6d00c284e99 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.224642 Sep 19 11:55:48.933057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1728/3482] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:48 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:48.986957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:48.995888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85a16d44-df56-412d-a2f7-16ef1bbe3362 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083289 Sep 19 11:55:48.996459 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1755/3483] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:48 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:49.934126 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:49.934737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:49.937096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=68 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:49.941802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:49.942290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:49.942728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:49.943451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:49.943912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:49.944342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:49.959728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:49.960319 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:49.966360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:49.966901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:49.967363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:49.968047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:49.968538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:49.968967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:50.145226 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:50.149997 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:50.154265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9a998abe-1676-411c-85bd-7693965c9e50 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.223941 Sep 19 11:55:50.154943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1729/3484] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:49 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:50.159198 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:50.159580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:50.160187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:50.160658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:50.161819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3f124189-7fae-4b20-afd2-6f4a8218b421 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.206112 Sep 19 11:55:50.162520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1756/3485] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:49 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:50.166108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:50.166594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:50.167031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:50.167753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:50.168212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:50.168645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:50.232347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:50.240637 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5a11c7b8-6d3b-44b8-aece-8e3e4d5d81f7 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084767 Sep 19 11:55:50.241212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1730/3486] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:50 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:51.178686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:51.179317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:51.181728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=76 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:51.186726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:51.187271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:51.187271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:51.187501 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:51.187693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:51.188393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:51.188850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:51.189281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:51.194495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:51.194974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:51.195439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:51.196128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:51.196571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:51.196991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:51.396447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:51.400973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:51.405177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e7fd4e50-c9ae-4b1f-922d-a190aed0b7bf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.230974 Sep 19 11:55:51.405758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1757/3487] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:51 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:51.410165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:51.410649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:51.411808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:51.412168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:51.413582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-adbc4576-0497-4224-85cc-c806379d9784 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.230777 Sep 19 11:55:51.414153 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1731/3488] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:51 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:55:51.418056 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:51.418540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:51.418976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:51.419706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:51.420153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:51.420576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:51.482466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:51.491297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1215347b-657e-44f3-9cc3-e5f62f358a71 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084541 Sep 19 11:55:51.491869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1758/3489] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:51 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:52.430051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:52.430748 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:52.438879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:52.439528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:52.440028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:52.440788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:52.441316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:52.441591 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:52.442089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:52.442223 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:52.449774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:52.450346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:52.450995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:52.451926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:52.452587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:52.453334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:52.642443 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:52.646492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:52.651020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-63f3fa3b-f019-4ab3-9147-c36488c69fc5 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.225871 Sep 19 11:55:52.651569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1732/3490] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:52 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:52.656041 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:52.656650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:52.660464 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:52.661976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:52.662781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:52.663302 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:52.663446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-57667e85-3c74-4540-935e-df8a70439b91 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.226009 Sep 19 11:55:52.663751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:52.667778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1759/3491] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:52 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:52.667945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:52.667945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:52.667945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:52.728500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:52.736691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-203aa7fb-10fe-43be-9169-06613f815601 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.084179 Sep 19 11:55:52.737263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1733/3492] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:52 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:53.673935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:53.674569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:53.681783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:53.682271 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:53.682715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:53.683432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:53.683940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:53.684327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:53.689759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:53.690373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:53.697001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:53.697497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:53.697943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:53.698646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:53.699101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:53.699565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:53.882512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:53.889446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:53.892060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b86f0caf-c559-446b-8c50-83743cfa7640 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221179 Sep 19 11:55:53.892060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1760/3493] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:53 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:53.896549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:53.897225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:53.898469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:53.900011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:53.901421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ed5186f7-82fc-4167-b364-6be7eb0779d1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216068 Sep 19 11:55:53.902145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1734/3494] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:53 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:53.904906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:53.905496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:53.906040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:53.906824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:53.907661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:53.908298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:53.973458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:53.982290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3eb288c2-277d-4157-90cb-5e95cd21f948 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089253 Sep 19 11:55:53.982861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1761/3495] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:53 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:54.914972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:54.915600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:54.922164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:54.922657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:54.923103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:54.925696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:54.926176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:54.926595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:54.930309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:54.930960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:54.938783 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:54.939278 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:54.939724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:54.940423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:54.940888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:54.941317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:55.139363 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:55.143417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:55.148445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-56080c26-bc27-487c-887c-2c338e185843 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.237377 Sep 19 11:55:55.149031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1735/3496] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:54 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:55.152560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:55.153611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:55.154395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:55.155062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:55.155708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-49a2f60c-b10e-4d19-831e-29a434613aff tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.230980 Sep 19 11:55:55.156274 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1762/3497] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:54 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:55.163539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:55.164036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:55.164476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:55.165459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:55.166093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:55.166528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:55.236714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:55.245047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e7c82e3f-a8b6-4463-8cbc-0e1dbef72ec8 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.095034 Sep 19 11:55:55.245751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1736/3498] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:55 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:56.179093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:56.179765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:56.182258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:56.182873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:56.186296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:56.186782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:56.187244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:56.187949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:56.188402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:56.188828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:56.189331 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:56.189819 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:56.190267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:56.190951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:56.191448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:56.191881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:56.382219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:56.386259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:56.390628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-75b59593-3c56-4d06-b7ec-9264c6eb02af tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216058 Sep 19 11:55:56.391251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1763/3499] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:56 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:56.394998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:56.396964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:56.398131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-84c94011-d4ee-41da-88a4-0de0497d5e38 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219783 Sep 19 11:55:56.398673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1737/3500] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:56 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:56.399120 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:56.399850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:56.406322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:56.406816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:56.407565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:56.408496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:56.408957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:56.409384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:56.480590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:56.488841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-29eff684-449c-4b0c-99f6-70449f3f2104 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.096045 Sep 19 11:55:56.489418 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1764/3501] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:56 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:57.416186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:57.416755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:57.423129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:57.423644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:57.424079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:57.424506 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:57.424953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:57.425103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:57.425223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:57.425622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:57.431451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:57.431934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:57.433330 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:57.434041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:57.434488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:57.434913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:57.622276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:57.626258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:57.631256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e04680a0-74f9-4c54-ac42-088da03f7998 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.218964 Sep 19 11:55:57.631864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1738/3502] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:57 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:57.636078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:57.636472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:57.637277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:57.637532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:57.638919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf30e1c4-1240-4eda-843a-23c894094721 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.218265 Sep 19 11:55:57.639502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1765/3503] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:57 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:57.650673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:57.651210 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:57.651684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:57.652376 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:57.652831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:57.653254 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:57.671587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:57.714846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:57.723042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3809e18c-8368-4082-9cfa-41b86a11dc9c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090248 Sep 19 11:55:57.723679 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1739/3504] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:57 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:58.655002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:58.655914 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:58.663068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:58.663359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:58.663710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:58.664409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:58.664861 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:58.665286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:58.668639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:58.669350 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:58.678294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:58.678784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:58.679330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:58.680035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:58.680520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:58.681791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:58.864885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:58.868462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:55:58.868811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:58.874326 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ee7e7755-a876-4902-96e9-9c8b79c7b9bc tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.223162 Sep 19 11:55:58.882965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1766/3505] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:58 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:58.883221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:58.883221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:58.883508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:58.883508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:58.883716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3dd4c6cc-9c97-4899-9a6e-3e81e2708f9d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220253 Sep 19 11:55:58.883716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1740/3506] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:58 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:55:58.892682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:58.892682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:58.892682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:58.892682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:58.893150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:58.893150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:58.953740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:55:58.962080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-91621235-9ad1-49a8-983f-53a04fb76721 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085666 Sep 19 11:55:58.962652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1767/3507] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:58 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:55:59.901836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:59.902491 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:59.908049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:55:59.909217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:55:59.909383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:59.909717 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:59.910160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:59.910855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:59.911595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:59.912030 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:59.915386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:59.915872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:59.916334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:55:59.917018 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:55:59.917471 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:55:59.917888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:00.107912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:00.110977 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:00.118116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9e3f4e64-8734-46af-8ad0-bb392ae58d68 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.219995 Sep 19 11:56:00.118701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1741/3508] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:55:59 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:00.120622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:00.122166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:00.123368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ebcd9702-454b-42e8-b9ba-c3b5fd8c1a94 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219370 Sep 19 11:56:00.123531 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:00.124063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:00.124309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1768/3509] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:55:59 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:00.130596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:00.131223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:00.131660 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:00.132342 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:00.132791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:00.133336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:00.193899 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:00.202032 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-21eba085-5329-4505-8b39-d44125f2dee3 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.082360 Sep 19 11:56:00.202600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1742/3510] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:00 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:01.148594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:01.149208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:01.149875 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:01.150565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:01.155948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:01.156441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:01.157795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:01.157923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:01.157923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:01.158146 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:01.158344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:01.158454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:01.158774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:01.159038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:01.159524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:01.159953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:01.358876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:01.362589 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:01.368903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9924eb6c-131f-44c5-903d-dff1d26d0416 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.224706 Sep 19 11:56:01.369879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1769/3511] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:01 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:01.371655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:01.373089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:01.374242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6603d768-2102-4a76-b275-dbfc85ab69d6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.228934 Sep 19 11:56:01.374790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1743/3512] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:01 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:01.378966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:01.380666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:01.391729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:01.396077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:01.396077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:01.396077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:01.396077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:01.396869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:01.462184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:01.471424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c44cc145-db1e-4b8e-a73b-b11c41966a93 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.099953 Sep 19 11:56:01.471990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1770/3513] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:01 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:02.401400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:02.401942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:02.408754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:02.409243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:02.409682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:02.410382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:02.411430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:02.411869 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:02.412394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:02.413042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:02.419773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:02.420265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:02.420708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:02.421406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:02.421867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:02.422298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:02.601792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:02.610631 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:02.612168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:02.612491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:02.613470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1cdfc0ec-f05b-44f0-a4e2-07b9c937118b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.216263 Sep 19 11:56:02.614120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1744/3514] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:02.619721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:02.619721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:02.624929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:02.625482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:02.625980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:02.626185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-224d8d2a-98d8-4c4e-be23-06d37bef1dce tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.218322 Sep 19 11:56:02.626942 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:02.627112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1771/3515] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:02 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:56:02.632559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:02.633113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:02.697190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:02.705487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f14b56f3-0f6d-41fa-b912-187a45ea345b tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090339 Sep 19 11:56:02.706053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1745/3516] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:02 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:03.639623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:03.640230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:03.646668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:03.647150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:03.647622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:03.648308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:03.648756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:03.649204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:03.649367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:03.649981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:03.656697 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:03.657441 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:03.657870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:03.658552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:03.659001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:03.659448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:03.848925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:03.856754 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:03.859290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:03.860750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:03.861574 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0e9c8e9e-1f50-44ac-b65e-7c14f6af1cff tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.216042 Sep 19 11:56:03.861958 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0c250282-9dfa-4d31-abea-1accf752703e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.226238 Sep 19 11:56:03.862463 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1746/3517] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:03 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:56:03.862910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1772/3518] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:03 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:03.868039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:03.868645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:03.874464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:03.874938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:03.875410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:03.876093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:03.876768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:03.877382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:03.942987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:03.951628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f29b304f-1687-4edb-808f-ffbe4d5395d4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087462 Sep 19 11:56:03.952204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1747/3519] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:03 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:04.886462 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:04.887207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:04.888192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:04.888810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:04.893806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:04.894242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:04.894688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:04.895194 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:04.895463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:04.895730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:04.895921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:04.896350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:04.896467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:04.897056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:04.897569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:04.897943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:05.088091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:05.091810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:05.096524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fdb734ff-60cf-482a-ad01-5a486fc4c404 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.214115 Sep 19 11:56:05.097105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1773/3520] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:04 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:05.101078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:05.102292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:05.102511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:05.102906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:05.103742 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-334d88b9-4ecd-4efc-89d7-0946a6f7d230 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.219475 Sep 19 11:56:05.104469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1748/3521] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:04 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:05.109405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:05.110793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:05.110793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:05.116521 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:05.117023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:05.117469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:05.178270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:05.186478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fbe2ccab-0126-42c8-885f-320d38b8d7aa tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.088430 Sep 19 11:56:05.187300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1774/3522] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:05 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:06.120599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:06.121228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:06.128388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:06.128889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:06.129950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:06.130431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:06.130912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:06.131043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:06.131146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:06.131581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:06.138035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:06.138524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:06.138964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:06.139724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:06.140185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:06.140614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:06.328715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:06.335634 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:06.337056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6cde6e5e-e9cf-4b34-a46e-1fa03b80a842 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.220339 Sep 19 11:56:06.337647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1749/3523] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:06 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:06.342299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:06.342912 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:06.344908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:06.346475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:06.347719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1416d3d7-89ef-4fdd-b3a2-8997ae0c86c6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.221912 Sep 19 11:56:06.348460 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1775/3524] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:06 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:06.348859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:06.349505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:06.349956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:06.350661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:06.351117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:06.351573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:06.414101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:06.422449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3774625d-1973-4969-a526-7db30aecfdd4 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083762 Sep 19 11:56:06.423017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1750/3525] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:06 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:07.360320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:07.360939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:07.368050 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:07.368477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:07.369008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:07.369711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:07.370187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:07.370588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:07.373853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:07.374468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:07.381127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:07.381902 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:07.382355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:07.385078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:07.386585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:07.395726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:07.574756 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:07.578037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:07.583737 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-69b913ae-f3f2-46ef-8708-35d73af9ccbb tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.227328 Sep 19 11:56:07.584497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1776/3526] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:07 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:07.587966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:07.588947 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:07.589427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:07.589611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:07.590601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2f230306-076b-41db-9e4c-a26b4d4ea2ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.220654 Sep 19 11:56:07.591335 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1751/3527] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:07 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:07.596143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:07.596695 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:07.597199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:07.597963 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:07.599532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:07.600125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:07.662889 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:07.671245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-95543823-12ec-4002-b8b8-15bd4da7a4eb tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085773 Sep 19 11:56:07.671826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1777/3528] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:07 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:08.608279 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:08.608891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:08.615497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:08.615983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:08.616420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:08.616571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:08.617069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:08.617183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:08.617551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:08.617971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:08.623447 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:08.623925 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:08.624356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:08.625048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:08.625503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:08.625923 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:08.816275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:08.824264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:08.825737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1491cf87-2714-4187-b54c-0efd27862c1d tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.221334 Sep 19 11:56:08.826333 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1752/3529] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:08 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:56:08.830945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:08.831580 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:08.833859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:08.835313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:08.836586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-80153879-eb92-4966-8d0b-e292be6cf18d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.224066 Sep 19 11:56:08.844466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1778/3530] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:08 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:08.844644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:08.844644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:08.844644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:08.844644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:08.845086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:08.845086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:08.902682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:08.911222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0a2ae957-68f9-4589-b18b-39001bfdb74c tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.083906 Sep 19 11:56:08.911792 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1753/3531] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:08 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:09.851151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:09.851573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:09.857964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:09.858451 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:09.858895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:09.859633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:09.860095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:09.860526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:09.863198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:09.863953 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:09.870252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:09.870743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:09.871195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:09.871911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:09.872405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:09.872832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:10.002820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:10.011765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-58b2f5a2-a17c-4969-b329-cab2e857688b tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.165510 Sep 19 11:56:10.012381 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1779/3532] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:09 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:10.017006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:10.017620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:10.024316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:10.024807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:10.025243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:10.025952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:10.026408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:10.026836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:10.115100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:10.122740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ef1cf66c-d05d-4eb3-954b-2e0d61625390 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.109337 Sep 19 11:56:10.123469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1780/3533] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:10 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:10.177403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:10.186145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:10.187611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:10.188776 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-991f8f5e-789b-4475-9638-16ab0749159a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.329503 Sep 19 11:56:10.189337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1754/3534] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:09 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:11.037366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:11.038024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:11.044722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:11.045273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:11.045716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:11.046417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:11.046878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:11.047340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:11.145803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:11.146524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:11.153022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:11.153512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:11.164102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:11.164102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:11.164102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:11.164102 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:11.184648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:11.193201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ef7285b0-fe24-4715-adbd-217139ac6bcf tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.160203 Sep 19 11:56:11.193827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1781/3535] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:11 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:11.213980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:11.214588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:11.218900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:11.221086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:11.221573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:11.222014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:11.222709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:11.223862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:11.224287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:11.227676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fb5ac8d9-410a-47ad-9dff-db45857713b5 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.085686 Sep 19 11:56:11.228252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1755/3536] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:11 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:56:11.352682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:11.362063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:11.365157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:11.367428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9559ccd7-a260-47b6-8835-b7619f58b358 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.157121 Sep 19 11:56:11.368448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1782/3537] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:11 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:12.217353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:12.218075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:12.224548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:12.225038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:12.225486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:12.226174 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:12.226634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:12.227068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:12.230973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=100 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:12.251069 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:12.251772 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:12.259057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:12.259573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:12.260012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:12.260698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:12.261147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:12.261570 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:12.280171 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:12.388951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:12.394651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:12.399272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0cb23e8d-2775-4cd0-a54c-87a2e2124de0 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.151946 Sep 19 11:56:12.399867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1783/3538] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:12 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:56:12.403844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-210fbcda-8ef5-49cd-b231-c011a392c538 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.190338 Sep 19 11:56:12.404409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1756/3539] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:12 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:12.404553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:12.405122 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:12.414023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:12.414825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:12.415539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:12.416736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:12.417549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:12.418172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:12.544416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:12.553028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:12.554482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:12.555683 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-207f5d6e-c2d1-4c98-a8a5-6bddadba6e31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.154900 Sep 19 11:56:12.556236 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1784/3540] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:12 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:13.423722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:13.424314 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:13.428009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:13.428636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:13.431336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:13.431830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:13.432266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:13.432956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:13.433413 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:13.433838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:13.435149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:13.435661 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:13.436097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:13.436782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:13.437230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:13.437658 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:13.507000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:13.515163 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-60f82802-6458-441c-8cc7-021fe966569a tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.095554 Sep 19 11:56:13.515756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1757/3541] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:13 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:13.581844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:13.582988 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:13.588919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:13.589407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:13.589847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:13.590327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:13.590544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:13.590998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:13.591458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:13.599190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-543a1913-bd37-4fac-ab42-033572b3e7b1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.175635 Sep 19 11:56:13.599769 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1785/3542] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:13 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:56:13.721096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:13.730505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:13.732037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:13.733201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-704c5c23-a3cf-4f96-8bd1-3fb9f0bb8551 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.155293 Sep 19 11:56:13.733756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1758/3543] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:13 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:14.538943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:14.539567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:14.546234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:14.546801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:14.547196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:14.547882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:14.548339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:14.548768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:14.613778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:14.621740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:14.622242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-24645f52-ef93-4c24-bd82-332635630b6d tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.087833 Sep 19 11:56:14.622394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:14.622827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1786/3544] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:14 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:14.628790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:14.629306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:14.629744 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:14.630437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:14.630893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:14.631348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:14.759726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:14.760344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:14.761535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:14.766311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:14.766816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:14.767269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:14.767966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:14.768426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:14.768857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:14.770273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c17e84f0-e504-4507-aa6c-adcdd1908e28 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.151766 Sep 19 11:56:14.770849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1759/3545] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:14 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:56:14.894472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:14.903746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:14.905197 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:14.906366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad047e4e-9697-4daa-ae59-0282c6444509 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.150628 Sep 19 11:56:14.907193 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1787/3546] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:14 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:15.644428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:15.645150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:15.651591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:15.652077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:15.652513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:15.653202 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:15.653786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:15.654222 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:15.720966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:15.730716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5c459b73-4d0a-45ec-aea3-8d02ca90f440 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.090032 Sep 19 11:56:15.731296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1760/3547] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:15 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:15.793585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:15.794199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:15.800667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:15.801725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:15.802165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:15.802850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:15.803343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:15.803776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:15.930432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:15.932683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:15.933299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:15.938780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-53329905-f494-4f7d-ba95-908a7ce891d1 tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.149106 Sep 19 11:56:15.939377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1788/3548] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:15 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:15.939515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:15.939927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:15.940371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:15.941072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:15.941536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:15.941964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:16.070218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:16.078632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:16.080131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:16.081466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-052a9cce-14c6-4d59-8d72-4c214abaed83 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 200 len: 1803 microversion: 2.20 time: 0.153296 Sep 19 11:56:16.082568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1761/3549] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:15 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 1803 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:16.108080 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c0e503a7-96c2-470d-bbb0-dcf28af6a40e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '.version_select at 0x7f4b9ddb2af0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:16.204006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c0e503a7-96c2-470d-bbb0-dcf28af6a40e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188245809" status: 204 len: 0 microversion: 2.20 time: 0.099754 Sep 19 11:56:16.204540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1789/3550] 10.222.0.78 () {60 vars in 1262 bytes} [Mon Sep 19 11:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1188245809 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 11:56:16.756112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:16.756759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] [instance: 416dd466-0154-4d9a-af4a-9f87010ce3a3] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:16.763943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:16.764432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:16.765027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:16.765571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:16.766401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:16.766565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:16.832392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28638075e935490bb7c8c229de9d14c5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ec8ddabe0fd049de97da2f63453aabef', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:16.840755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ca71dda6-d9e6-41b2-aacf-4f033c48fcea tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3" status: 200 len: 1390 microversion: 2.1 time: 0.089495 Sep 19 11:56:16.841323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1762/3551] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:16 2022] GET /compute/v2.1/servers/416dd466-0154-4d9a-af4a-9f87010ce3a3 => generated 1390 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:16.862789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7a7cab84-3465-4a15-b68d-4925d0af4de2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] Calling method '.version_select at 0x7f4b9a43e0d0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:16.921112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7a7cab84-3465-4a15-b68d-4925d0af4de2 tempest-TestMinimumBasicScenario-752154063 tempest-TestMinimumBasicScenario-752154063-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1153350230" status: 202 len: 0 microversion: 2.1 time: 0.062168 Sep 19 11:56:16.921726 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1790/3552] 10.222.0.78 () {58 vars in 1272 bytes} [Mon Sep 19 11:56:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1153350230 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 11:56:16.961849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:16.962465 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] [instance: 95347db7-c8c7-4731-8d6c-32d6fec8d721] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:16.974230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:16.974728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:16.982049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:16.982840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:16.983399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:16.983812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:17.142725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4682f63b56d24450b2605b5b4c2129d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '575748e2f3ee4df18ce5aa403175b66f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:17.153183 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0537ae95-d245-48d0-9cfb-e146f0125e3e tempest-VolumesSnapshotTestJSON-970313362 tempest-VolumesSnapshotTestJSON-970313362-project] 10.222.0.78 "GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721" status: 200 len: 1558 microversion: 2.1 time: 0.195162 Sep 19 11:56:17.167204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1763/3553] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:56:16 2022] GET /compute/v2.1/servers/95347db7-c8c7-4731-8d6c-32d6fec8d721 => generated 1558 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:56:17.596132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-256072b2-712f-4813-98ce-f7af619dda64 req-7854c9bb-47aa-4d9e-856e-ab32c0b9e5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:56:17.608567 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-256072b2-712f-4813-98ce-f7af619dda64 req-7854c9bb-47aa-4d9e-856e-ab32c0b9e5e9 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:17.609367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-256072b2-712f-4813-98ce-f7af619dda64 req-7854c9bb-47aa-4d9e-856e-ab32c0b9e5e9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:17.610045 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-256072b2-712f-4813-98ce-f7af619dda64 req-7854c9bb-47aa-4d9e-856e-ab32c0b9e5e9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:17.628337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-256072b2-712f-4813-98ce-f7af619dda64 req-7854c9bb-47aa-4d9e-856e-ab32c0b9e5e9 service nova] Creating event network-changed:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 11:56:17.637263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-256072b2-712f-4813-98ce-f7af619dda64 req-7854c9bb-47aa-4d9e-856e-ab32c0b9e5e9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127733 Sep 19 11:56:17.638151 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1791/3554] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:56:17.698650 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c5e641c3-4217-47f3-a9b4-c80ea9968098 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'create', calling method: .version_select at 0x7f4b9b9e4280>, body: {"keypair": {"name": "tempest-keypair-1936922600", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGj0/0NY71SB/Rwj0eGQ9dpA9pi9FUXf86VB9tBlaeVbYLUBhJMI74mk2c5V/sNmRNVtRYZYDn7U0Vkzokzkv/+enllgCas4Vz8FdUDIqSeiIHJJEOCFlAxdbjYWx4Tzaw=="}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:56:17.726120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-c5e641c3-4217-47f3-a9b4-c80ea9968098 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:56:17.730571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-c5e641c3-4217-47f3-a9b4-c80ea9968098 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for user 5a8fb193bdd1448eab774bd1eef437c9 and project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:56:17.847488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c5e641c3-4217-47f3-a9b4-c80ea9968098 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.153262 Sep 19 11:56:17.853200 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1764/3555] 10.222.0.78 () {62 vars in 1200 bytes} [Mon Sep 19 11:56:17 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 155 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 19 11:56:20.434367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-235071266", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f739e757-0e77-4020-9623-8f44464bfc43"}], "security_groups": [{"name": "tempest-securitygroup--1764927149"}], "key_name": "tempest-keypair-1936922600", "user_data": "}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:56:20.557186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] validate_networks() for [('f739e757-0e77-4020-9623-8f44464bfc43', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:56:21.008224 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:56:21.008648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:56:21.009158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:56:21.009575 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:56:21.010011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:56:21.018755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:21.019263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:21.019766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:21.020508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:21.020994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:21.021424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:21.039862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:56:21.044086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Getting quotas for user 5a8fb193bdd1448eab774bd1eef437c9 and project 0ddce6e2bc7841d495afa07655d7d25f. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:56:21.057836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:56:21.060616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:56:21.224457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e646c641-d565-4144-8f6f-3bdec622c5c0 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.795620 Sep 19 11:56:21.225880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1792/3556] 10.222.0.78 () {62 vars in 1188 bytes} [Mon Sep 19 11:56:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 798 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 19 11:56:21.237736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6e6687bd-3519-40b0-a1c6-c01bafd2eeb9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:21.238426 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e6687bd-3519-40b0-a1c6-c01bafd2eeb9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:21.240859 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:21.300155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6e6687bd-3519-40b0-a1c6-c01bafd2eeb9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:21.315603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6e6687bd-3519-40b0-a1c6-c01bafd2eeb9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:21.315603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6e6687bd-3519-40b0-a1c6-c01bafd2eeb9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:21.315603 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6e6687bd-3519-40b0-a1c6-c01bafd2eeb9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1281 microversion: 2.20 time: 0.080761 Sep 19 11:56:21.316076 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1765/3557] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:21 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:22.339615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:22.340232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:22.342300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=87,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:22.348602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:22.349094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:22.349535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:22.350232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:22.350689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:22.351125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:22.423101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:22.436190 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:22.437804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:22.438944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-63f32877-d181-4aa8-8b66-44e9d68e416c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1285 microversion: 2.20 time: 0.104102 Sep 19 11:56:22.439543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1793/3558] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:22 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1285 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:23.465476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:23.466132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:23.473947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:23.474497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:23.474950 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:23.475769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:23.476232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:23.476656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:23.599414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:23.610628 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:23.614013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:23.614013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a99fc4db-69b5-4207-b677-28dba3fac9f5 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1333 microversion: 2.20 time: 0.151832 Sep 19 11:56:23.618778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1766/3559] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:23 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1333 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:24.640150 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:24.640708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:24.647952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:24.648741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:24.649365 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:24.650272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:24.650910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:24.651569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:24.934655 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:24.947230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:24.949320 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:24.950877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a5184670-a5bd-4cc6-a88a-e814fda299bd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1407 microversion: 2.20 time: 0.315122 Sep 19 11:56:24.952208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1794/3560] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:24 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1407 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:25.737732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-ac427d1d-c720-467d-b5f4-0e08480ca371 req-3fd92149-c261-43c2-bba0-a53209732270 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f828522-227a-4ba6-828a-ddfce72850e0", "tag": "acf38022-7de3-46c1-8bfb-c9b18c3f57a0"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:56:25.773352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ac427d1d-c720-467d-b5f4-0e08480ca371 req-3fd92149-c261-43c2-bba0-a53209732270 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:25.775622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ac427d1d-c720-467d-b5f4-0e08480ca371 req-3fd92149-c261-43c2-bba0-a53209732270 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:25.776343 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ac427d1d-c720-467d-b5f4-0e08480ca371 req-3fd92149-c261-43c2-bba0-a53209732270 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:25.790347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-ac427d1d-c720-467d-b5f4-0e08480ca371 req-3fd92149-c261-43c2-bba0-a53209732270 service nova] Creating event network-changed:acf38022-7de3-46c1-8bfb-c9b18c3f57a0 for instance 9f828522-227a-4ba6-828a-ddfce72850e0 on hv-cinder-82282 Sep 19 11:56:25.813458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-ac427d1d-c720-467d-b5f4-0e08480ca371 req-3fd92149-c261-43c2-bba0-a53209732270 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080932 Sep 19 11:56:25.814286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1767/3561] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:56:25.977624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:25.978243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:25.986775 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:25.988288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:25.988288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:25.991922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:25.992431 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:25.995383 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:26.260701 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:26.270105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:26.272006 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:26.273400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d3e49e59-1fe3-4267-8a2f-1d09454c05f2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1407 microversion: 2.20 time: 0.299853 Sep 19 11:56:26.291296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1795/3562] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:25 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1407 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:27.301105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:27.301796 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:27.308482 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:27.309028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:27.309469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:27.310164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:27.310616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:27.311100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:27.551118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:27.560061 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:27.561520 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:27.562714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49e735e4-c1f5-4790-abb6-6cc6739d82a1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1407 microversion: 2.20 time: 0.266529 Sep 19 11:56:27.563287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1768/3563] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:27 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:28.591590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:28.592212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:28.599430 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:28.599932 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:28.600408 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:28.601115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:28.601618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:28.602103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:28.739149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:28.747693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:28.749123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:28.750248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-dd754c60-6151-4717-8443-b800d0949ee2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1407 microversion: 2.20 time: 0.163643 Sep 19 11:56:28.750810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1796/3564] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:28 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:29.776192 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:29.776886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:29.783565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:29.784053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:29.784521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:29.785224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:29.785682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:29.786114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:29.914553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:29.923118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:29.924599 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:29.925727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ffcb12fb-62dd-46da-8333-d534b7e22ba6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1407 microversion: 2.20 time: 0.153438 Sep 19 11:56:29.926289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1769/3565] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:29 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:30.952120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:30.953551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:30.960578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:30.960993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:30.961632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:30.962337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:30.962795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:30.963241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:31.030082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:31.054682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:31.111115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:31.122873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:31.124459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:31.124782 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-886b3f3d-b24d-4fab-9703-77d74c64c0f6 req-88491480-0475-455b-9651-eaa6af642f38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f828522-227a-4ba6-828a-ddfce72850e0", "name": "network-vif-plugged", "status": "completed", "tag": "acf38022-7de3-46c1-8bfb-c9b18c3f57a0"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:56:31.125755 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-23f202a4-cd48-48d5-92cc-b764724ceb9a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1407 microversion: 2.20 time: 0.177802 Sep 19 11:56:31.126298 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1770/3566] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:30 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:31.135353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-886b3f3d-b24d-4fab-9703-77d74c64c0f6 req-88491480-0475-455b-9651-eaa6af642f38 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:31.135935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-886b3f3d-b24d-4fab-9703-77d74c64c0f6 req-88491480-0475-455b-9651-eaa6af642f38 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:31.136433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-886b3f3d-b24d-4fab-9703-77d74c64c0f6 req-88491480-0475-455b-9651-eaa6af642f38 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:31.147379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-886b3f3d-b24d-4fab-9703-77d74c64c0f6 req-88491480-0475-455b-9651-eaa6af642f38 service nova] Creating event network-vif-plugged:acf38022-7de3-46c1-8bfb-c9b18c3f57a0 for instance 9f828522-227a-4ba6-828a-ddfce72850e0 on hv-cinder-82282 Sep 19 11:56:31.152349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-886b3f3d-b24d-4fab-9703-77d74c64c0f6 req-88491480-0475-455b-9651-eaa6af642f38 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.233636 Sep 19 11:56:31.152938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1797/3567] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:56:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:56:32.151827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:32.152436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:32.154355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:56:32.160570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:32.161058 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:32.161498 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:32.162193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:32.162652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:32.163082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:32.292244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:32.301085 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:32.302551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:32.303713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e1e765c5-9c05-4601-ab07-dff6f531bf35 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1407 microversion: 2.20 time: 0.155854 Sep 19 11:56:32.304278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1771/3568] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:32 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 11:56:33.329461 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:33.330143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:33.336908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:33.337388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:33.337818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:33.338496 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:33.338942 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:33.339401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:33.472878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:33.480844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:33.482270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:56:33.483433 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-973c2bef-1911-4c72-9cbd-239c50c46ca6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1598 microversion: 2.20 time: 0.158703 Sep 19 11:56:33.483994 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1798/3569] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 11:56:33 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1598 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 11:56:33.508069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:56:33.508611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:56:33.514999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:33.515805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:33.516246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:33.516943 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:33.517406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:33.517838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:33.592130 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2cec797c-34ea-4645-a075-1d0adecc3b3d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087872 Sep 19 11:56:33.592734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1772/3570] 10.222.0.78 () {60 vars in 1316 bytes} [Mon Sep 19 11:56:33 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 19 11:56:34.842641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-d3895d80-3d2f-4eee-9ff5-b5fdb3a88369 req-0c3e91bd-a160-42da-aedf-22e9a6bab85a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9f828522-227a-4ba6-828a-ddfce72850e0", "tag": "acf38022-7de3-46c1-8bfb-c9b18c3f57a0"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:56:34.852693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d3895d80-3d2f-4eee-9ff5-b5fdb3a88369 req-0c3e91bd-a160-42da-aedf-22e9a6bab85a service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:56:34.853167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d3895d80-3d2f-4eee-9ff5-b5fdb3a88369 req-0c3e91bd-a160-42da-aedf-22e9a6bab85a service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:56:34.853598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d3895d80-3d2f-4eee-9ff5-b5fdb3a88369 req-0c3e91bd-a160-42da-aedf-22e9a6bab85a service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:56:34.864590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-d3895d80-3d2f-4eee-9ff5-b5fdb3a88369 req-0c3e91bd-a160-42da-aedf-22e9a6bab85a service nova] Creating event network-changed:acf38022-7de3-46c1-8bfb-c9b18c3f57a0 for instance 9f828522-227a-4ba6-828a-ddfce72850e0 on hv-cinder-82282 Sep 19 11:56:34.869745 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-d3895d80-3d2f-4eee-9ff5-b5fdb3a88369 req-0c3e91bd-a160-42da-aedf-22e9a6bab85a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030769 Sep 19 11:56:34.870342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1799/3571] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:09.725881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=17 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:09.726718 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=82 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:09.727561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 11:57:09.727710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 11:57:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/ips (ip 10.222.0.78) !!! Sep 19 11:57:09.732168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:09.732652 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:09.740119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:09.740597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:09.746009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:09.746009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:09.746009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:09.746009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:09.766694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-38e06fbd-e43b-440a-8aed-4c9728e1789c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/ips" status: 200 len: 151 microversion: 2.20 time: 0.042182 Sep 19 11:57:09.771957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1773/3572] 10.222.0.78 () {60 vars in 1289 bytes} [Mon Sep 19 11:57:09 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/ips => generated 151 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 11:57:16.189950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=13 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:16.190776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=70 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:16.195380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:16.195961 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:16.202366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:16.202855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:16.203317 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:16.204010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:16.205053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:16.205484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:16.231892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d HTTP/1.1 Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 11:57:16.233611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.235468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '01c2424a-e9d7-4e1c-918a-f7b718b4fd0d'} Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:16.236428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.237999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.239523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:16.239523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6f8bd927-07e7-4089-a0a2-57acee0fec5d tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "DELETE /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 404 len: 111 microversion: 2.1 time: 0.047234 Sep 19 11:57:16.239523 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1800/3573] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 11:57:16 2022] DELETE /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:16.243601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:16.244223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] [instance: 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:16.251974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:16.252470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:16.252907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:16.253607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:16.254069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:16.254518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:16.268049 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] HTTP exception thrown: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Request method failure captured: Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d HTTP/1.1 Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGTQ6tfv1PJp-azbD1R5KyjXC30fZix2AJvW1W4GBnSHHrylYWq6plMNVwLaHY8gdxCoWcusf0UKQj-YUEWyOUEpk1t2ks8YaYBoiqZyecKwWNiJmaTbTNK2vDFEbK6YmR6WROE0LZAfyAhRRYlkzAOyumGBg5LSn5n3y4vQiboRfQ Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 11:57:16.269721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/4767407e0fb04faaaa3a520128aa88df"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 4767407e0fb04faaaa3a520128aa88df Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1384393155 Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 405b3189506a44bc93555c40917b4cbe Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeTestJSON-1384393155-project Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.271837 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '01c2424a-e9d7-4e1c-918a-f7b718b4fd0d'} Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 11:57:16.273120 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. Sep 19 11:57:16.275011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 11:57:16.276873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] Returning 404 to user: Instance 01c2424a-e9d7-4e1c-918a-f7b718b4fd0d could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 11:57:16.276873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-05a79bcd-49ea-4446-92cb-0fbe497fa750 tempest-AttachVolumeTestJSON-1384393155 tempest-AttachVolumeTestJSON-1384393155-project] 10.222.0.78 "GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d" status: 404 len: 111 microversion: 2.1 time: 0.031378 Sep 19 11:57:16.276873 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1774/3574] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:16 2022] GET /compute/v2.1/servers/01c2424a-e9d7-4e1c-918a-f7b718b4fd0d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 11:57:27.531979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:27.648088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ca2ef215-90ae-4bc4-8f53-e8368d9cdaf4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: .version_select at 0x7f4b9a284b80>, body: {"keypair": {"name": "tempest-keypair-1150126440", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKJVgAO+UdM/Gw1dH3b9oPDy3SXspqtRTri58SxNwelAi0k/bs+RGqt/XqpXBUAljB2jZdybVzH9e6dEyrQZHaIzE0mS+oNW+ePuJRVtK+gw0cwLceksmsPDggEoQqEX/w=="}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:27.665617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-ca2ef215-90ae-4bc4-8f53-e8368d9cdaf4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:27.669812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-ca2ef215-90ae-4bc4-8f53-e8368d9cdaf4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:27.776289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ca2ef215-90ae-4bc4-8f53-e8368d9cdaf4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.249555 Sep 19 11:57:27.776743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1801/3575] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 11:57:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:30.328904 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1382009391", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73bc4776-a82b-41a8-8ce8-a6075f380581"}], "security_groups": [{"name": "tempest-securitygroup--540970020"}], "key_name": "tempest-keypair-1150126440", "user_data": "}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:30.338885 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:30.342451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:30.658488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] validate_networks() for [('73bc4776-a82b-41a8-8ce8-a6075f380581', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 11:57:31.148001 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 11:57:31.148427 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 11:57:31.149131 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 11:57:31.149545 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 11:57:31.149964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 11:57:31.162665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:31.163389 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:31.163987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:31.164722 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:31.165180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:31.165610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:31.186642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 11:57:31.191662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 11:57:31.204537 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 11:57:31.206987 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 11:57:31.350846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3a6db4ee-07da-46f3-8c3d-f2c327658f91 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.027518 Sep 19 11:57:31.354830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1775/3576] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 11:57:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 1029 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 11:57:31.367478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d192e02c-9943-469f-bfb4-2f71b9b74129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:31.372166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d192e02c-9943-469f-bfb4-2f71b9b74129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:31.429815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d192e02c-9943-469f-bfb4-2f71b9b74129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:31.432293 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d192e02c-9943-469f-bfb4-2f71b9b74129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1242 microversion: 2.1 time: 0.073085 Sep 19 11:57:31.432978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1802/3577] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:31 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:32.454971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:32.455605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:32.461932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:32.462538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:32.462978 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:32.463703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:32.464175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:32.464583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:32.533421 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:32.541127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a03f5a6c-31b1-4a6e-b372-7ab5b57e0d95 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1246 microversion: 2.1 time: 0.090591 Sep 19 11:57:32.541810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1776/3578] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:32 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1246 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:33.565334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:33.566041 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:33.572901 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:33.573448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:33.573887 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:33.574590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:33.575043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:33.575513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:33.646063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:33.654078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a3c927aa-f0f8-4642-aefe-f548e05abfbb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1302 microversion: 2.1 time: 0.093096 Sep 19 11:57:33.654892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1803/3579] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:33 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1302 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:34.678479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:34.679053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:34.685345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:34.685834 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:34.686271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:34.686963 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:34.687442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:34.687871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:34.893291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:34.901062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0a094c06-9ef4-4741-b61f-bf637e2547ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.226548 Sep 19 11:57:34.901588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1777/3580] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:34 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:35.363981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-0b4eea41-2ebe-4837-9278-feec0ad719c5 req-12aa77b4-8e73-4177-bfb7-e667fea6cdc7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c0e76f-dae0-4337-bc81-8d5def6ea5bd", "tag": "5ae18733-17b4-4ae7-bf79-00e2dd5a8e30"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:35.374979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-0b4eea41-2ebe-4837-9278-feec0ad719c5 req-12aa77b4-8e73-4177-bfb7-e667fea6cdc7 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:35.376061 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-0b4eea41-2ebe-4837-9278-feec0ad719c5 req-12aa77b4-8e73-4177-bfb7-e667fea6cdc7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:35.376787 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-0b4eea41-2ebe-4837-9278-feec0ad719c5 req-12aa77b4-8e73-4177-bfb7-e667fea6cdc7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:35.389133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-0b4eea41-2ebe-4837-9278-feec0ad719c5 req-12aa77b4-8e73-4177-bfb7-e667fea6cdc7 service nova] Creating event network-changed:5ae18733-17b4-4ae7-bf79-00e2dd5a8e30 for instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd on hv-cinder-82282 Sep 19 11:57:35.394771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-0b4eea41-2ebe-4837-9278-feec0ad719c5 req-12aa77b4-8e73-4177-bfb7-e667fea6cdc7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090529 Sep 19 11:57:35.395528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1804/3581] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:57:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:35.925815 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:35.926411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:35.932964 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:35.933445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:35.933879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:35.934559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:35.935009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:35.935472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:36.063419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:36.071079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ed05fe52-443c-4a73-8156-6dbd30b1a43b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.149819 Sep 19 11:57:36.071666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1778/3582] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:35 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:37.096063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:37.096796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:37.102943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:37.103467 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:37.103908 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:37.104600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:37.105054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:37.105477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:37.398990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:37.407065 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d64a639c-52d2-4693-ba43-73149f0ce633 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.316413 Sep 19 11:57:37.407779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1805/3583] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:37 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:38.429972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:38.430577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:38.437275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:38.437768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:38.438805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:38.439553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:38.440010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:38.440439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:38.567858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:38.575519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bcc23d41-8d6e-4661-909f-deb4a14b3c61 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.149441 Sep 19 11:57:38.576187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1779/3584] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:38 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:39.597752 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:39.598355 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:39.605008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:39.605494 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:39.605930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:39.606616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:39.607073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:39.607532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:39.738219 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:39.745875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fd624115-0ba7-427e-97c3-9f12a703f2bc tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.151930 Sep 19 11:57:39.746444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1806/3585] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:39 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:40.769042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:40.769656 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:40.776143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:40.776629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:40.777074 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:40.777764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:40.778221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:40.778917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:40.909275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:40.917005 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-241d4bc4-72e5-42fb-ac8a-50b023b9d85d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.152354 Sep 19 11:57:40.917570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1780/3586] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:40 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:41.487503 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-59ee47da-4cdc-4b82-9ca8-f0be429889df req-b7d0f9d7-e897-4bc1-bf20-0cab1fea5a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c0e76f-dae0-4337-bc81-8d5def6ea5bd", "name": "network-vif-plugged", "status": "completed", "tag": "5ae18733-17b4-4ae7-bf79-00e2dd5a8e30"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:41.491277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:41.496609 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-59ee47da-4cdc-4b82-9ca8-f0be429889df req-b7d0f9d7-e897-4bc1-bf20-0cab1fea5a87 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:41.497163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-59ee47da-4cdc-4b82-9ca8-f0be429889df req-b7d0f9d7-e897-4bc1-bf20-0cab1fea5a87 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:41.497608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-59ee47da-4cdc-4b82-9ca8-f0be429889df req-b7d0f9d7-e897-4bc1-bf20-0cab1fea5a87 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:41.509145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-59ee47da-4cdc-4b82-9ca8-f0be429889df req-b7d0f9d7-e897-4bc1-bf20-0cab1fea5a87 service nova] Creating event network-vif-plugged:5ae18733-17b4-4ae7-bf79-00e2dd5a8e30 for instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd on hv-cinder-82282 Sep 19 11:57:41.514127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-59ee47da-4cdc-4b82-9ca8-f0be429889df req-b7d0f9d7-e897-4bc1-bf20-0cab1fea5a87 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032890 Sep 19 11:57:41.516362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1807/3587] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:57:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:41.940424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:41.941037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:41.942918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:41.943600 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:57:41.948924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:41.949492 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:41.949932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:41.962884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:41.962884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:41.962884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:42.085455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:42.093387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-04b8a8df-04d1-4945-af50-977525741a14 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.157029 Sep 19 11:57:42.094529 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1781/3588] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:41 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:43.118077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:43.118776 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:43.125802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:43.126324 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:43.126768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:43.127511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:43.127970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:43.128401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:43.260967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:43.268888 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9d4c67b-2e8c-434c-acb3-6a551e36754a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1367 microversion: 2.1 time: 0.155807 Sep 19 11:57:43.269458 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1808/3589] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:43 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 11:57:44.296150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:44.296798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:44.303933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:44.304424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:44.304866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:44.305596 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:44.306057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:44.306490 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:44.442583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 11:57:44.450372 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6be031b9-b6d8-472d-8e77-c66380204e62 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1558 microversion: 2.1 time: 0.158062 Sep 19 11:57:44.450933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1782/3590] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 11:57:44 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1558 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 11:57:44.472967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:57:44.473508 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:57:44.480139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:44.480631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:44.481101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:44.481800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:44.482261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:44.482694 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:44.563978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a9c44290-1af0-416e-a5c5-93afa74e9fbd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094908 Sep 19 11:57:44.564573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1809/3591] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 11:57:44 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:57:45.563139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-8be6e258-648f-4547-a98c-afca516c6849 req-358c0951-79e5-441b-91b8-4e37d6071ed9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f2c0e76f-dae0-4337-bc81-8d5def6ea5bd", "tag": "5ae18733-17b4-4ae7-bf79-00e2dd5a8e30"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 11:57:45.573845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8be6e258-648f-4547-a98c-afca516c6849 req-358c0951-79e5-441b-91b8-4e37d6071ed9 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:57:45.574358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8be6e258-648f-4547-a98c-afca516c6849 req-358c0951-79e5-441b-91b8-4e37d6071ed9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:57:45.574794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8be6e258-648f-4547-a98c-afca516c6849 req-358c0951-79e5-441b-91b8-4e37d6071ed9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:57:45.588344 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-8be6e258-648f-4547-a98c-afca516c6849 req-358c0951-79e5-441b-91b8-4e37d6071ed9 service nova] Creating event network-changed:5ae18733-17b4-4ae7-bf79-00e2dd5a8e30 for instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd on hv-cinder-82282 Sep 19 11:57:45.593611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-8be6e258-648f-4547-a98c-afca516c6849 req-358c0951-79e5-441b-91b8-4e37d6071ed9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035399 Sep 19 11:57:45.595097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1783/3592] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 11:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 11:58:21.704689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.706169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=32 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 11:58:21.709922 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 11:58:21.710415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 11:58:21.716208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:21.716690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:21.717129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:21.717816 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 11:58:21.718279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 11:58:21.718706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 11:58:21.742218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cb10f50d-1608-491b-8431-8d943ba53d2e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/ips" status: 200 len: 150 microversion: 2.1 time: 0.039062 Sep 19 11:58:21.742784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1810/3593] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 11:58:21 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:08.443570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c5ebcaf-5fcc-467e-864b-bd7760c36cbf] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=46 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 12:01:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments (ip 10.222.0.78) !!! Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 12:01:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments (ip 10.222.0.78) !!! Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:01:08.449518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 12:01:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments (ip 10.222.0.78) !!! Sep 19 12:01:08.454846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa67850f-d817-4089-9ef8-cb82df1990d3"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:08.457843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:08.469783 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:08.470274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:08.470725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:08.471997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:08.472449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:08.476752 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.013650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a61e391-cf5e-4b5b-8e83-9b022a7b5946] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 12:01:09.015475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:01:09.015640 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 12:01:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/action (ip 10.222.0.78) !!! Sep 19 12:01:09.017173 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:01:09.017466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 12:01:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/action (ip 10.222.0.78) !!! Sep 19 12:01:09.019801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:01:09.020052 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 12:01:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/action (ip 10.222.0.78) !!! Sep 19 12:01:09.028981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:09.029520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:09.046967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.047492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.047935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.048645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.049199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.049615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.073990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lazy-loading 'flavor' on Instance uuid 9f828522-227a-4ba6-828a-ddfce72850e0 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:01:09.453020 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c5ebcaf-5fcc-467e-864b-bd7760c36cbf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 43128. Sep 19 12:01:09.540564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-24aab37e-87aa-436a-816c-1c26a98360c2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/action" status: 202 len: 0 microversion: 2.20 time: 0.528909 Sep 19 12:01:09.541170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1811/3594] 10.222.0.78 () {62 vars in 1319 bytes} [Mon Sep 19 12:01:09 2022] POST /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/action => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:01:09.546920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:09.550161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:09.554452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.554930 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.555394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.556078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.556527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.556951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.589071 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:01:09.873436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ad0af09e-7c36-4601-95cc-1c0410638310 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 204 len: 0 microversion: 2.1 time: 0.330352 Sep 19 12:01:09.874095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1812/3595] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:01:09 2022] DELETE /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:01:09.879612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:09.880299 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:09.886016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.886489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.886920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:09.887638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:09.888083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:09.888505 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:10.022141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:10.025965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-203ca884-a1b9-4b1e-adfa-22f6063bc742 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.583355 Sep 19 12:01:10.026591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1784/3596] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 12:01:08 2022] POST /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments => generated 194 bytes in 1586 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:10.032393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:10.034444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:10.035660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ded039c7-42c8-4880-8791-04b610c7c67e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.160488 Sep 19 12:01:10.044308 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1813/3597] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:09 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:10.044958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-c7d9cb52-55c8-42a6-a1e8-1675ce2259a5 req-d5aa8149-1bf2-462e-8c04-5a7a293c40df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7226154-6dfa-424f-b89e-fb320490d32c", "name": "network-vif-deleted", "tag": "cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:10.045095 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a61e391-cf5e-4b5b-8e83-9b022a7b5946] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 43140. Sep 19 12:01:10.050169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:10.058842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c7d9cb52-55c8-42a6-a1e8-1675ce2259a5 req-d5aa8149-1bf2-462e-8c04-5a7a293c40df service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:10.058842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c7d9cb52-55c8-42a6-a1e8-1675ce2259a5 req-d5aa8149-1bf2-462e-8c04-5a7a293c40df service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:10.058842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c7d9cb52-55c8-42a6-a1e8-1675ce2259a5 req-d5aa8149-1bf2-462e-8c04-5a7a293c40df service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:10.059436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:10.061688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:10.062405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:10.062859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:10.063594 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:10.064057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:10.064524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:10.066184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-c7d9cb52-55c8-42a6-a1e8-1675ce2259a5 req-d5aa8149-1bf2-462e-8c04-5a7a293c40df service nova] Creating event network-vif-deleted:cd1c1f1b-3a0e-48b7-9bdc-ed1f9447696d for instance e7226154-6dfa-424f-b89e-fb320490d32c on hv-cinder-82282 Sep 19 12:01:10.072299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-c7d9cb52-55c8-42a6-a1e8-1675ce2259a5 req-d5aa8149-1bf2-462e-8c04-5a7a293c40df service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044315 Sep 19 12:01:10.072984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1785/3598] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:10.201160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:10.210073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-63ba4b8c-eeaf-4e7f-a8ce-cd421598dc31 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1507 microversion: 2.1 time: 0.172753 Sep 19 12:01:10.211282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1814/3599] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:10 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1507 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:11.062513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:11.063157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:11.070015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:11.070499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:11.070941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:11.071669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:11.072129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:11.072563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:11.206710 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:11.214959 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:11.216442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:11.223793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e7c17a8c-4e7a-4ac4-9fc2-29bfce7350c8 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.159956 Sep 19 12:01:11.223793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1786/3600] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:11 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:11.234808 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:11.235455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:11.242606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:11.243093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:11.243581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:11.244279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:11.244855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:11.245291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:11.373611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:11.381210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6c710750-4b3a-4999-8ed8-67f80092afa3 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1507 microversion: 2.1 time: 0.150444 Sep 19 12:01:11.381790 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1815/3601] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:11 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1507 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:12.243714 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:12.244456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:12.250996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:12.251518 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:12.252662 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:12.253305 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:12.253763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:12.254197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:12.387053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:12.395489 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:12.397207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:12.398414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9fa9caae-592e-4b93-b26c-c50e22f172f4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.158635 Sep 19 12:01:12.398976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1787/3602] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:12 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:12.404375 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:12.404986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:12.411715 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:12.412208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:12.412892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:12.413597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:12.414067 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:12.414501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:12.597329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:12.605352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7f80f93b-db2c-4f9a-a70f-0271a94748d8 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1507 microversion: 2.1 time: 0.204837 Sep 19 12:01:12.605981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1816/3603] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:12 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1507 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:13.279523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-49811548-1e70-440e-9cf4-4932d5da7027 req-98183eb9-25bb-4025-b059-32900320bd3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95347db7-c8c7-4731-8d6c-32d6fec8d721", "name": "network-vif-deleted", "tag": "cf3336fd-b54c-402f-a55d-8aa092952d23"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:13.306337 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-49811548-1e70-440e-9cf4-4932d5da7027 req-98183eb9-25bb-4025-b059-32900320bd3e service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.307863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-49811548-1e70-440e-9cf4-4932d5da7027 req-98183eb9-25bb-4025-b059-32900320bd3e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.309583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-49811548-1e70-440e-9cf4-4932d5da7027 req-98183eb9-25bb-4025-b059-32900320bd3e service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.363825 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-49811548-1e70-440e-9cf4-4932d5da7027 req-98183eb9-25bb-4025-b059-32900320bd3e service nova] Creating event network-vif-deleted:cf3336fd-b54c-402f-a55d-8aa092952d23 for instance 95347db7-c8c7-4731-8d6c-32d6fec8d721 on hv-cinder-82282 Sep 19 12:01:13.371084 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-49811548-1e70-440e-9cf4-4932d5da7027 req-98183eb9-25bb-4025-b059-32900320bd3e service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096880 Sep 19 12:01:13.372595 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1788/3604] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:13.424569 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:13.425959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:13.436335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.438971 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.440527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.441512 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.442214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.442896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.600138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:13.611371 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:13.612983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:13.614328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7ffa2b67-69d6-463f-b760-b05736d7c3d7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.193861 Sep 19 12:01:13.614985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1817/3605] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:13 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:13.637079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:13.638140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:13.646592 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.647094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.647568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.648291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.649068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.649191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.800888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:13.809677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bd269775-7329-4445-aa84-52bb6eb2d508 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1507 microversion: 2.1 time: 0.176665 Sep 19 12:01:13.810923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1789/3606] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:13 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1507 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:13.890734 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-6bcceba3-5103-419c-bdd5-b1e402608b12 req-e4132811-83b4-4987-9008-a3142ce2dfb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f892bd2-0650-4e0b-b0cf-4c101d48c1e1", "name": "network-vif-deleted", "tag": "6ac5a146-2fb2-4d85-bf90-5543fd4e51e7"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:13.903015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-6bcceba3-5103-419c-bdd5-b1e402608b12 req-e4132811-83b4-4987-9008-a3142ce2dfb7 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:13.903538 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-6bcceba3-5103-419c-bdd5-b1e402608b12 req-e4132811-83b4-4987-9008-a3142ce2dfb7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:13.904180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-6bcceba3-5103-419c-bdd5-b1e402608b12 req-e4132811-83b4-4987-9008-a3142ce2dfb7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:13.920400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-6bcceba3-5103-419c-bdd5-b1e402608b12 req-e4132811-83b4-4987-9008-a3142ce2dfb7 service nova] Creating event network-vif-deleted:6ac5a146-2fb2-4d85-bf90-5543fd4e51e7 for instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 on hv-cinder-82282 Sep 19 12:01:13.926628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-6bcceba3-5103-419c-bdd5-b1e402608b12 req-e4132811-83b4-4987-9008-a3142ce2dfb7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039474 Sep 19 12:01:13.927360 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1818/3607] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:14.642221 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:14.643315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:14.650010 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:14.650493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:14.650958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:14.651694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:14.652134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:14.652560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:14.780984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:14.789657 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:14.791090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:14.792256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c5b1946b-7391-4f99-b593-c1374fe28ab2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.154188 Sep 19 12:01:14.792809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1790/3608] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:14 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:14.838135 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:14.838825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:14.845100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:14.845581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:14.846048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:14.846699 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:14.847440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:14.847871 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:14.879226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:14.879740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:14.880169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:14.880611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lazy-loading 'fault' on Instance uuid 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:01:14.921898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:14.929535 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-385638e0-8a30-43b8-a19b-a0a685a4013b tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 200 len: 1311 microversion: 2.1 time: 0.096209 Sep 19 12:01:14.930093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1819/3609] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:14 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 1311 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:15.818164 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:15.818713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:15.825121 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:15.825615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:15.826035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:15.826712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:15.827155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:15.827598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:15.956382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:15.957002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:15.962685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:15.963626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:15.964121 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:15.964564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:15.965469 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:15.965983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:15.966440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:15.971116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:15.973213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:15.974395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a18f2dc4-cb5a-4cc1-9cd4-c85b0e66100c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.160154 Sep 19 12:01:15.975039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1791/3610] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:15 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:15.980980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] HTTP exception thrown: Instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 could not be found. Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Request method failure captured: Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 HTTP/1.1 Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFGNVNYktEzfhUQJvHMqhHDK5885Dq_w4mmZ-Ru1g2xuVoENu2t7CE6A8PssN2VKCsc7rqJMKN6hgjiCIzRV8wuFmlhnNe5PCcyISBHYGqapoAGFwwRZ-rXc1X0qoxG3kNafW7daV6Lcpq_b7u6a-msfeZS8KQ9cr3HEUFgpCHebR-M Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:01:15.982652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: d6fee905418f4d879da460b6758d4f23 Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 could not be found. Sep 19 12:01:15.984625 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '7f892bd2-0650-4e0b-b0cf-4c101d48c1e1'} Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 could not be found. Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:01:15.985815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 could not be found. Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 could not be found. Sep 19 12:01:15.987544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:01:15.989090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Returning 404 to user: Instance 7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:01:15.989090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2bc5cea7-998e-4e1b-bc0d-c4bafdcca602 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1" status: 404 len: 111 microversion: 2.1 time: 0.032061 Sep 19 12:01:15.989090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1820/3611] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:15 2022] GET /compute/v2.1/servers/7f892bd2-0650-4e0b-b0cf-4c101d48c1e1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:01:15.992781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:15.993277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:15.999383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:15.999876 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:16.000316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:16.001009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:16.001460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:16.001907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:16.028469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:01:16.341966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6e604b86-85fc-45a0-9b91-0c655d725162 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "DELETE /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 204 len: 0 microversion: 2.1 time: 0.352715 Sep 19 12:01:16.342565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1792/3612] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:01:15 2022] DELETE /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:01:16.351636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:16.353010 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:16.359201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:16.359703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:16.360163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:16.360849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:16.361313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:16.361743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:16.497580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:16.505960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-40fbf9b2-5596-444b-a5dd-7d68e2f526c6 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1521 microversion: 2.1 time: 0.158633 Sep 19 12:01:16.506548 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1821/3613] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:16 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:17.001590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:17.002398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:17.008727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:17.009523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:17.010029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:17.010983 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:17.011526 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:17.012059 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:17.155864 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:17.164395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:17.165828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:17.167028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-be17d33f-6c02-432f-b12f-579cff2a60ed tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.170609 Sep 19 12:01:17.167611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1793/3614] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:16 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:17.482744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-e94b039d-2c6e-4d54-ac2c-92d3f37eb19e req-3c5507e5-5cb3-481b-97bd-daf4d6d33769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "844fd60f-68da-4b43-a8d2-fae5e0a6cf45", "name": "network-vif-deleted", "tag": "291f03b6-9596-4181-8c7c-5524563b0f56"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:17.492672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-e94b039d-2c6e-4d54-ac2c-92d3f37eb19e req-3c5507e5-5cb3-481b-97bd-daf4d6d33769 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:17.493140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-e94b039d-2c6e-4d54-ac2c-92d3f37eb19e req-3c5507e5-5cb3-481b-97bd-daf4d6d33769 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:17.494089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-e94b039d-2c6e-4d54-ac2c-92d3f37eb19e req-3c5507e5-5cb3-481b-97bd-daf4d6d33769 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:17.505352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-e94b039d-2c6e-4d54-ac2c-92d3f37eb19e req-3c5507e5-5cb3-481b-97bd-daf4d6d33769 service nova] Creating event network-vif-deleted:291f03b6-9596-4181-8c7c-5524563b0f56 for instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 on hv-cinder-82282 Sep 19 12:01:17.510622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-e94b039d-2c6e-4d54-ac2c-92d3f37eb19e req-3c5507e5-5cb3-481b-97bd-daf4d6d33769 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086514 Sep 19 12:01:17.511257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1822/3615] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:01:17.529039 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:17.529646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:17.535713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:17.536195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:17.536627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:17.537310 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:17.537760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:17.538176 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:17.600712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6fee905418f4d879da460b6758d4f23', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7f4d504e02a645b6a5ebc78ed0bc5a41', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:17.608661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-19666c78-fac9-4d42-99f0-3dfcab189d4e tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 200 len: 1479 microversion: 2.1 time: 0.083408 Sep 19 12:01:17.610190 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1794/3616] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:17 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 1479 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:18.194608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:18.195338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:18.201544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:18.202015 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:18.202457 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:18.203145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:18.203633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:18.204062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:18.335638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:18.347820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:18.352057 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:18.353243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-83fee91d-9c98-4c93-b68d-80eae73f0950 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.163539 Sep 19 12:01:18.353804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1823/3617] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:18 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:18.632646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:18.633264 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] [instance: 844fd60f-68da-4b43-a8d2-fae5e0a6cf45] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:18.640304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:18.640691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:18.641136 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:18.641842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:18.642308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:18.642739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:18.657146 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] HTTP exception thrown: Instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 could not be found. Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Request method failure captured: Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 HTTP/1.1 Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFGNVNYktEzfhUQJvHMqhHDK5885Dq_w4mmZ-Ru1g2xuVoENu2t7CE6A8PssN2VKCsc7rqJMKN6hgjiCIzRV8wuFmlhnNe5PCcyISBHYGqapoAGFwwRZ-rXc1X0qoxG3kNafW7daV6Lcpq_b7u6a-msfeZS8KQ9cr3HEUFgpCHebR-M Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:01:18.658860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/7f4d504e02a645b6a5ebc78ed0bc5a41"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 7f4d504e02a645b6a5ebc78ed0bc5a41 Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-161315032 Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: d6fee905418f4d879da460b6758d4f23 Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-ServerRescueNegativeTestJSON-161315032-project Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 could not be found. Sep 19 12:01:18.661284 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '844fd60f-68da-4b43-a8d2-fae5e0a6cf45'} Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 could not be found. Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:01:18.662212 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 could not be found. Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 could not be found. Sep 19 12:01:18.669817 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:01:18.671737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] Returning 404 to user: Instance 844fd60f-68da-4b43-a8d2-fae5e0a6cf45 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:01:18.671737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-77945fe3-9963-4c07-9b24-599312f7a3d5 tempest-ServerRescueNegativeTestJSON-161315032 tempest-ServerRescueNegativeTestJSON-161315032-project] 10.222.0.78 "GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45" status: 404 len: 111 microversion: 2.1 time: 0.032928 Sep 19 12:01:18.671737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1795/3618] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:18 2022] GET /compute/v2.1/servers/844fd60f-68da-4b43-a8d2-fae5e0a6cf45 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:01:19.392415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:19.393203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:19.405140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:19.405628 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:19.411909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:19.411909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:19.411909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:19.411909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:19.610230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:19.614296 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:19.619400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:19.622455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:19.622455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7d724ed8-ac80-4172-b196-71967bfbde28 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.233635 Sep 19 12:01:19.622720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1824/3619] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:19 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:20.648480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:20.649701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:20.656884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:20.657370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:20.657803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:20.658494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:20.658944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:20.659926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:20.811831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:20.821311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:20.822884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:20.824134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fca4589a-8fb5-4da1-8302-d030806cc73d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.180555 Sep 19 12:01:20.824715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1796/3620] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:20 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:21.854771 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:21.855450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:21.863585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:21.864072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:21.864518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:21.865221 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:21.865864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:21.866350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:22.078967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:22.090849 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:22.094541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:22.096089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7de5acb9-c4ba-41cc-ab68-87e1541fef41 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.245323 Sep 19 12:01:22.098163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1825/3621] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:21 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:23.123140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:23.123853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:23.130833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:23.133249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:23.133719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:23.134439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:23.134991 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:23.138615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:23.288810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:23.297299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:23.298786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:23.300590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0e88a0b4-1df6-45db-a5d4-d993b888996e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.181554 Sep 19 12:01:23.301152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1797/3622] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:23 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:24.071127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-131eed03-8973-4ff5-b477-717fb1dec579 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: .version_select at 0x7f4b9a2f84c0>, body: {"keypair": {"name": "tempest-keypair-1683104908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEaMtEF+Hk39UNjQaSDs4w2SRraxV/XGc+46RPotz3AK9390LAcEsvW7F6axKHy01OTra7PPzBYunlFKD+h35ogiwkCwNbXzZusGPjYNRJ8RQV/fo3eF16V6hDKkwuU73g=="}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:24.088779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-131eed03-8973-4ff5-b477-717fb1dec579 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:01:24.091821 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-131eed03-8973-4ff5-b477-717fb1dec579 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:01:24.201153 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-131eed03-8973-4ff5-b477-717fb1dec579 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.133916 Sep 19 12:01:24.201844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1826/3623] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 12:01:24 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:24.326038 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:24.327348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:24.334028 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:24.334539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:24.334971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:24.335683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:24.336137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:24.336555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:24.512985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:24.521824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:24.523324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:24.524527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-54fb8fe2-39fa-46a9-86e0-13cec309bb88 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.202365 Sep 19 12:01:24.525093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1798/3624] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:24 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:01:25.563340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:25.563950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:25.571158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:25.571677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:25.572111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:25.572825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:25.573284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:25.573712 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:25.805473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:25.813811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:25.815281 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:25.816490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d2d795d1-2a4a-4a9a-bfef-da940e6b09cd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.258439 Sep 19 12:01:25.817456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1827/3625] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:25 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:26.842934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:26.843571 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:26.850497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:26.850982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:26.851449 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:26.852147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:26.852263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2113280027", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73bc4776-a82b-41a8-8ce8-a6075f380581"}], "security_groups": [{"name": "tempest-securitygroup--304727306"}], "key_name": "tempest-keypair-1683104908", "user_data": "}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:26.852734 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:26.853014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:26.871340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:26.991832 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] validate_networks() for [('73bc4776-a82b-41a8-8ce8-a6075f380581', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:01:27.072096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:27.080573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:27.082027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:27.083921 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8de67264-9ebe-4f1b-a655-e800292a9181 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.244526 Sep 19 12:01:27.084488 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1799/3626] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:26 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:27.530806 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:01:27.531251 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:01:27.531722 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:01:27.532134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:01:27.532546 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:01:27.541328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:27.541822 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:27.542238 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:27.542957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:27.543436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:27.543857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:27.565539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:01:27.570284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:01:27.586478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:01:27.588862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:01:27.706039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0efa7214-cf85-4743-b20c-27f129dd15dd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.858572 Sep 19 12:01:27.706696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1828/3627] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 12:01:26 2022] POST /compute/v2.1/servers => generated 401 bytes in 860 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:01:27.718758 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4f6d2ad3-5b73-4a11-b462-8d5794bac6ec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:27.719877 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4f6d2ad3-5b73-4a11-b462-8d5794bac6ec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:27.782197 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4f6d2ad3-5b73-4a11-b462-8d5794bac6ec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:27.789946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4f6d2ad3-5b73-4a11-b462-8d5794bac6ec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1242 microversion: 2.1 time: 0.075108 Sep 19 12:01:27.790539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1800/3628] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:27 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1242 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:28.109161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:28.109811 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:28.117106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:28.117291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:28.117733 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:28.118426 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:28.118881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:28.119335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:28.252484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:28.261217 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:28.262672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:28.263865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0b7427ee-86e2-4ed0-b876-159a8b561ba7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1744 microversion: 2.20 time: 0.159217 Sep 19 12:01:28.264428 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1829/3629] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:28 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1744 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:28.813915 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-5d427728-09e1-4ce5-9d58-38f3de64c69f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:28.814713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-5d427728-09e1-4ce5-9d58-38f3de64c69f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:28.880067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-5d427728-09e1-4ce5-9d58-38f3de64c69f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:28.889620 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-5d427728-09e1-4ce5-9d58-38f3de64c69f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1242 microversion: 2.1 time: 0.079749 Sep 19 12:01:28.890920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1801/3630] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:28 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1242 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:29.291855 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:29.292463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:29.298896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:29.302109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:29.302109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:29.302109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:29.302109 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:29.302534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:29.438053 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:29.449077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:29.449077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:29.449077 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-080ee0a6-9215-4905-b087-9cf8a7f310dd tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1744 microversion: 2.20 time: 0.161788 Sep 19 12:01:29.449636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1830/3631] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:29 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:29.914241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-18fdbfdc-40ee-4d63-9def-a3afebf0ad32 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:29.914846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-18fdbfdc-40ee-4d63-9def-a3afebf0ad32 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:29.969371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-18fdbfdc-40ee-4d63-9def-a3afebf0ad32 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:29.977858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-18fdbfdc-40ee-4d63-9def-a3afebf0ad32 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1242 microversion: 2.1 time: 0.067462 Sep 19 12:01:29.978431 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1802/3632] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:29 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:30.483466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:30.484140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:30.490949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:30.491486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:30.491928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:30.492626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:30.493187 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:30.493676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:30.624488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:30.633140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:30.634597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:30.635803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f8313d27-1350-493b-880a-5763d3d0b51f tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.157454 Sep 19 12:01:30.636362 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1831/3633] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:30 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:31.001468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-74d2fb83-07fa-4593-8043-3f2bf5ff3129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:31.002189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-74d2fb83-07fa-4593-8043-3f2bf5ff3129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:31.059019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-74d2fb83-07fa-4593-8043-3f2bf5ff3129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:31.066409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-74d2fb83-07fa-4593-8043-3f2bf5ff3129 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1242 microversion: 2.1 time: 0.068872 Sep 19 12:01:31.066985 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1803/3634] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:30 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1242 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:31.663263 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:31.663877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:31.670401 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:31.670896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:31.671367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:31.672058 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:31.672514 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:31.672943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:31.803835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:31.812344 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:31.813798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:31.814978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c9885e38-afc9-4c61-b060-29208e9ebd1d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.156391 Sep 19 12:01:31.815583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1832/3635] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:31 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:32.093484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:32.094240 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:32.100379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:32.100872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:32.101317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:32.102016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:32.102479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:32.102910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:32.166886 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:32.174887 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-04c83999-b757-4f13-8134-6eb8982e6009 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1246 microversion: 2.1 time: 0.087849 Sep 19 12:01:32.175504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1804/3636] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:32 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1246 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:32.839943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:32.845086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:32.847751 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:32.848248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:32.848689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:32.849400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:32.850363 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:32.850794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:32.986710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:32.996380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:32.997836 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:32.999017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f7d5c1b1-171c-4ef2-8174-8295e3a1852e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.163165 Sep 19 12:01:32.999608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1833/3637] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:32 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:33.197797 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:33.198410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:33.204823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:33.205315 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:33.205811 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:33.206810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:33.207297 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:33.208812 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:33.279057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:33.287598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-cb3e17a4-c804-4ce4-b519-1f0c5c54a295 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1246 microversion: 2.1 time: 0.093614 Sep 19 12:01:33.289771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1805/3638] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:33 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:34.026853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:34.037169 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:34.045346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:34.046136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:34.047048 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:34.048744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:34.049789 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:34.050504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:34.247764 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:34.260804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:34.263492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:34.265424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-97fcb86d-8a36-4a4e-a273-fde70597a3e9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.244437 Sep 19 12:01:34.267432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1834/3639] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:34 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:34.311043 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:34.311682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:34.321003 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:34.331480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:34.331927 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:34.337000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:34.337000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:34.337000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:34.437336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:34.448425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c592770c-2f17-4b13-9993-410ba50a8890 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1302 microversion: 2.1 time: 0.140705 Sep 19 12:01:34.454371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1806/3640] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:34 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1302 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:35.164099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-edaf318e-1f3a-4183-a15b-35fe77fb5e6f req-ec4892a1-fd93-43f2-9c45-791bf5abfc67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f828522-227a-4ba6-828a-ddfce72850e0", "name": "network-vif-plugged", "status": "completed", "tag": "acf38022-7de3-46c1-8bfb-c9b18c3f57a0"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:35.175823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-edaf318e-1f3a-4183-a15b-35fe77fb5e6f req-ec4892a1-fd93-43f2-9c45-791bf5abfc67 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:35.182123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-edaf318e-1f3a-4183-a15b-35fe77fb5e6f req-ec4892a1-fd93-43f2-9c45-791bf5abfc67 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:35.182123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-edaf318e-1f3a-4183-a15b-35fe77fb5e6f req-ec4892a1-fd93-43f2-9c45-791bf5abfc67 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:35.192859 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-edaf318e-1f3a-4183-a15b-35fe77fb5e6f req-ec4892a1-fd93-43f2-9c45-791bf5abfc67 service nova] Creating event network-vif-plugged:acf38022-7de3-46c1-8bfb-c9b18c3f57a0 for instance 9f828522-227a-4ba6-828a-ddfce72850e0 on hv-cinder-82282 Sep 19 12:01:35.199990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-edaf318e-1f3a-4183-a15b-35fe77fb5e6f req-ec4892a1-fd93-43f2-9c45-791bf5abfc67 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.276081 Sep 19 12:01:35.205349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1835/3641] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:35.325470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:35.325470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:35.325470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:35.325470 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:35.326610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:35.326610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:35.326610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:35.326610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:35.474627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:35.475927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:35.486216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:35.487123 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:35.488090 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:35.489128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:35.489827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:35.490803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:35.510114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:35.543237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:35.567971 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:35.579082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-98774aff-2605-4a31-a866-f4a425b67740 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.281611 Sep 19 12:01:35.583382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1807/3642] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:35 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:35.730315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:35.740311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cf4fc779-f5d7-4aed-82df-34b57cf74ec4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.270843 Sep 19 12:01:35.741759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1836/3643] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:35 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:36.611673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:36.613119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:36.637924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:36.638771 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:36.639551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:36.640994 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:36.641686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:36.642644 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:36.767235 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:36.771421 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:36.786797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:36.787988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:36.793784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:36.793784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:36.793784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:36.793784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:37.026616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:37.056468 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:37.059078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:37.061958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-010aca57-88be-4282-8205-3bcc468869ae tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.454358 Sep 19 12:01:37.067203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1808/3644] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:36 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:37.075346 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-74bfcd26-7b9f-443b-8f73-8c5d9832c6e9 req-7c3cd382-fb63-4c44-b705-799960326949 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd02539b-f152-4db4-be5d-25c9d87db229", "tag": "fe6538b7-4b97-4147-a20d-a470063baeb6"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:37.091550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-74bfcd26-7b9f-443b-8f73-8c5d9832c6e9 req-7c3cd382-fb63-4c44-b705-799960326949 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:37.091550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-74bfcd26-7b9f-443b-8f73-8c5d9832c6e9 req-7c3cd382-fb63-4c44-b705-799960326949 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:37.091550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-74bfcd26-7b9f-443b-8f73-8c5d9832c6e9 req-7c3cd382-fb63-4c44-b705-799960326949 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:37.108615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-74bfcd26-7b9f-443b-8f73-8c5d9832c6e9 req-7c3cd382-fb63-4c44-b705-799960326949 service nova] Creating event network-changed:fe6538b7-4b97-4147-a20d-a470063baeb6 for instance dd02539b-f152-4db4-be5d-25c9d87db229 on hv-cinder-82282 Sep 19 12:01:37.119923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-74bfcd26-7b9f-443b-8f73-8c5d9832c6e9 req-7c3cd382-fb63-4c44-b705-799960326949 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048056 Sep 19 12:01:37.119923 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1809/3645] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:37.183659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:37.183659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1fa6261c-9b1d-4acf-be48-98695f1da4b4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.410944 Sep 19 12:01:37.183659 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1837/3646] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:36 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:38.105602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:38.107713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:38.114832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:38.115409 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:38.116068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:38.117046 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:38.117898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:38.118723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:38.201829 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:38.202450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:38.207361 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:38.208398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=10 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:38.217802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:38.218295 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:38.218943 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:38.219904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:38.220534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:38.221644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:38.387828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:38.399813 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:38.401667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:38.405527 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b12ee53e-77b4-4247-9057-d38d6243e974 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.309447 Sep 19 12:01:38.420367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1810/3647] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:38 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:38.442222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:38.451127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-bb32e22c-243d-4e9b-9bef-9d76fe33b8d6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.253744 Sep 19 12:01:38.467445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1838/3648] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:38 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:39.441370 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:39.441962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:39.444997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:39.450090 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:39.450832 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:39.451307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:39.452016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:39.452666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:39.453097 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:39.480402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:39.481864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:39.485524 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:39.490623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:39.492032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:39.492704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:39.493636 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:39.494300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:39.494981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:39.687576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:39.704499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:39.706495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:39.707423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ec6b1c5d-6cc5-49b4-a0db-cc0a63062541 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.269949 Sep 19 12:01:39.708539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1811/3649] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:39 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:39.754321 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:39.763098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fd94f9e0-e732-4931-9540-c85f37257adf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.288806 Sep 19 12:01:39.763708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1839/3650] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:39 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:40.734654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:40.735769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:40.745889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:40.746379 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:40.746805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:40.747719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:40.748201 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:40.748803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:40.864781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:40.864781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:40.864781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:40.864781 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:40.865724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:40.865724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:40.865724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:40.865724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:41.047009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:41.055629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:41.057169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:41.058577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0758950e-063a-4236-bde5-fb13bc66f984 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.328046 Sep 19 12:01:41.073864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:41.075586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1812/3651] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:40 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:41.083608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-00df41bf-6d28-4700-a066-dc0e1d354a54 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.296921 Sep 19 12:01:41.084183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1840/3652] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:40 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:01:42.090614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:42.090614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:42.090614 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=8 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:42.095478 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.095982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.096428 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.097306 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.097777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.098195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.124990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:42.124990 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:42.136735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.137245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.137684 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.138404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:42.139073 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:42.139702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:42.427139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:42.436063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:42.437794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:42.439152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d5ece9ec-11b4-4b7f-9fb9-903931016f47 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.358545 Sep 19 12:01:42.462790 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1813/3653] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:42 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:42.491702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:42.500825 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7c305c6b-42e9-43db-a4be-1f38de046541 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.396010 Sep 19 12:01:42.501404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1841/3654] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:42 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:43.188118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-94fdc15e-c5e3-448a-9faa-88cbdf892831 req-9998a586-2627-4ff1-a203-264c1cf189bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd02539b-f152-4db4-be5d-25c9d87db229", "name": "network-vif-plugged", "status": "completed", "tag": "fe6538b7-4b97-4147-a20d-a470063baeb6"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:43.188118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-94fdc15e-c5e3-448a-9faa-88cbdf892831 req-9998a586-2627-4ff1-a203-264c1cf189bf service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.188118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-94fdc15e-c5e3-448a-9faa-88cbdf892831 req-9998a586-2627-4ff1-a203-264c1cf189bf service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.188118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-94fdc15e-c5e3-448a-9faa-88cbdf892831 req-9998a586-2627-4ff1-a203-264c1cf189bf service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.190641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-94fdc15e-c5e3-448a-9faa-88cbdf892831 req-9998a586-2627-4ff1-a203-264c1cf189bf service nova] Creating event network-vif-plugged:fe6538b7-4b97-4147-a20d-a470063baeb6 for instance dd02539b-f152-4db4-be5d-25c9d87db229 on hv-cinder-82282 Sep 19 12:01:43.190641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-94fdc15e-c5e3-448a-9faa-88cbdf892831 req-9998a586-2627-4ff1-a203-264c1cf189bf service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046178 Sep 19 12:01:43.190641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1814/3655] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:43.470584 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:43.471572 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:43.484719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.485216 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.485654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.491841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.491841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.491841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.566961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:43.567911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:43.580668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.597103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.602014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.603778 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:43.605047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:43.606196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:43.840702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:43.851857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:43.854826 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:43.856903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-06d9bd9c-f4c9-4ce4-abe0-d57b403e1d57 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.390731 Sep 19 12:01:43.877490 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1842/3656] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:43 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:43.916093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:43.925354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-357b7337-6ed9-4bda-b769-d7e2561e15b2 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.364383 Sep 19 12:01:43.926602 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1815/3657] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:43 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:44.884395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:44.885102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:44.892165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.892894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.893515 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:44.894397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.895013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.895952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:44.957993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:44.958627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:44.980157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.980680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.986564 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:44.988678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:44.991698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:44.992267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:45.213866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:45.213866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=100 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:45.213866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:45.214105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:45.214105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7ee82910-5ca4-472a-8e6c-d456923c138a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.302188 Sep 19 12:01:45.214105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1843/3658] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:44 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:45.214303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:45.214303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-09a5f23f-fdef-4210-96de-659054aa71c8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1367 microversion: 2.1 time: 0.254897 Sep 19 12:01:45.214303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1816/3659] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:44 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1367 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:46.208606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:46.209212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:46.216891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.217368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.217801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.218507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.218960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.219423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.240292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:46.240938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:46.247867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.248311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.248745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.249430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.249883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.250312 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.670935 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:46.680027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:46.680694 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:46.681463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:46.682642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-aeca7d05-a8d7-46b4-95b9-936f988e9907 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1739 microversion: 2.20 time: 0.478252 Sep 19 12:01:46.683222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1844/3660] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:46 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1739 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:01:46.688673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-06466819-d685-4b17-946b-caeef6316b45 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1557 microversion: 2.1 time: 0.452739 Sep 19 12:01:46.689235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1817/3661] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:01:46 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1557 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:01:46.711131 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:46.711711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:46.717743 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.718226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.718667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.719379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:46.719834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:46.720258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:46.802718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f938ca71-2612-4f11-8390-23c63cdc4230 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095124 Sep 19 12:01:46.804064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1845/3662] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 12:01:46 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:47.708910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:47.709525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:47.716597 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:47.717080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:47.717515 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:47.718207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:47.718661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:47.719089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:47.982775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:47.991024 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:47.992507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:47.993685 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d314b061-1559-496e-86a7-0bb4f8abc391 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1721 microversion: 2.20 time: 0.288742 Sep 19 12:01:47.994250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1818/3663] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:47 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1721 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:48.160241 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-88e292b8-1b67-4e31-a385-fd216a50a0b2 req-9b3d7110-3bfc-4a9c-a317-020aaab635dc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd02539b-f152-4db4-be5d-25c9d87db229", "tag": "fe6538b7-4b97-4147-a20d-a470063baeb6"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:48.170286 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-88e292b8-1b67-4e31-a385-fd216a50a0b2 req-9b3d7110-3bfc-4a9c-a317-020aaab635dc service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:48.170863 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-88e292b8-1b67-4e31-a385-fd216a50a0b2 req-9b3d7110-3bfc-4a9c-a317-020aaab635dc service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:48.171395 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-88e292b8-1b67-4e31-a385-fd216a50a0b2 req-9b3d7110-3bfc-4a9c-a317-020aaab635dc service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:48.182767 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-88e292b8-1b67-4e31-a385-fd216a50a0b2 req-9b3d7110-3bfc-4a9c-a317-020aaab635dc service nova] Creating event network-changed:fe6538b7-4b97-4147-a20d-a470063baeb6 for instance dd02539b-f152-4db4-be5d-25c9d87db229 on hv-cinder-82282 Sep 19 12:01:48.190519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-88e292b8-1b67-4e31-a385-fd216a50a0b2 req-9b3d7110-3bfc-4a9c-a317-020aaab635dc service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032065 Sep 19 12:01:48.190519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1846/3664] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:49.020535 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:49.021158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:49.028271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:49.028791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:49.029233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:49.029934 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:49.030395 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:49.030820 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:49.173281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:49.181735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:49.183248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:49.184496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1377733d-3054-4e08-af43-4e35d755e3c7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1721 microversion: 2.20 time: 0.168183 Sep 19 12:01:49.185055 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1819/3665] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:49 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:01:50.213416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:50.214116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:50.220842 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:50.221269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:50.221711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:50.222403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:50.222862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:50.223329 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:50.355452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:50.363566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:50.365028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:50.366184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-615fcb1c-e63d-40d8-a2ab-45f4a67a88eb tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1721 microversion: 2.20 time: 0.157670 Sep 19 12:01:50.366749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1847/3666] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:50 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:50.858114 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-34c347bd-81d3-4ff1-b64a-920f064ca07a req-866540c1-2235-41d4-a90d-857887a6eb7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f828522-227a-4ba6-828a-ddfce72850e0", "name": "network-vif-unplugged", "status": "completed", "tag": "acf38022-7de3-46c1-8bfb-c9b18c3f57a0"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:50.869293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-34c347bd-81d3-4ff1-b64a-920f064ca07a req-866540c1-2235-41d4-a90d-857887a6eb7b service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:50.869879 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-34c347bd-81d3-4ff1-b64a-920f064ca07a req-866540c1-2235-41d4-a90d-857887a6eb7b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:50.870445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-34c347bd-81d3-4ff1-b64a-920f064ca07a req-866540c1-2235-41d4-a90d-857887a6eb7b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:50.882496 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-34c347bd-81d3-4ff1-b64a-920f064ca07a req-866540c1-2235-41d4-a90d-857887a6eb7b service nova] Creating event network-vif-unplugged:acf38022-7de3-46c1-8bfb-c9b18c3f57a0 for instance 9f828522-227a-4ba6-828a-ddfce72850e0 on hv-cinder-82282 Sep 19 12:01:50.887791 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-34c347bd-81d3-4ff1-b64a-920f064ca07a req-866540c1-2235-41d4-a90d-857887a6eb7b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033771 Sep 19 12:01:50.888563 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1820/3667] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:01:50 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:01:51.395979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:51.396865 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:51.403133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.403903 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.407648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.407648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.407648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.407648 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.588995 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:51.598597 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:51.600180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:51.601448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-245b7808-077a-4e39-9e6e-3bcb4121bada tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1724 microversion: 2.20 time: 0.214059 Sep 19 12:01:51.602089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1848/3668] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:51 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1724 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:01:51.630307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77b851c1-cd93-456c-a9bc-191f05455d8e"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:51.633340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:51.639686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.640169 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.640607 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.641357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:51.641814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:51.642243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:51.777612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:01:52.837400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-eff6cc1c-2615-4b88-947a-8ca92620b27d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.211485 Sep 19 12:01:52.838017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1821/3669] 10.222.0.78 () {62 vars in 1364 bytes} [Mon Sep 19 12:01:51 2022] POST /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-volume_attachments => generated 188 bytes in 1213 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 19 12:01:52.975352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:52.976030 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:53.000682 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:53.001186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:53.001632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:53.002409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:53.002870 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:53.003345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.258275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a9dc9aa7-f6f7-418e-a3d9-1f25f9d7e4b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-volume_attachments/77b851c1-cd93-456c-a9bc-191f05455d8e" status: 202 len: 0 microversion: 2.20 time: 2.286831 Sep 19 12:01:55.258929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1849/3670] 10.222.0.78 () {60 vars in 1457 bytes} [Mon Sep 19 12:01:52 2022] DELETE /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-volume_attachments/77b851c1-cd93-456c-a9bc-191f05455d8e => generated 0 bytes in 2288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:01:55.322932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:01:55.323546 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:55.330741 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:55.331257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:55.331692 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.332373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:55.332827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:55.333246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.374713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121085) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 19 12:01:55.687219 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2902d482-6819-4920-a015-fd38658c961b tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "POST /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/action" status: 202 len: 0 microversion: 2.20 time: 0.368456 Sep 19 12:01:55.688018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1822/3671] 10.222.0.78 () {62 vars in 1319 bytes} [Mon Sep 19 12:01:55 2022] POST /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/action => generated 0 bytes in 370 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:01:55.697357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:55.697357 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:55.704560 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:55.705049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:55.705493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.706195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:55.706654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:55.707086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:55.838272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:55.846909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:55.848407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:55.849583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4d6b808e-6d6f-412f-a141-83a68fcedd3e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1672 microversion: 2.20 time: 0.156796 Sep 19 12:01:55.850710 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1850/3672] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:55 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:56.877145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:56.878530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:56.889216 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:56.889704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:56.890149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:56.890855 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:56.891397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:56.891831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:57.028109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:57.036539 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:57.037990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:57.039257 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-05957ac2-ed0c-4aa0-8225-1f75868ce8c4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1672 microversion: 2.20 time: 0.166977 Sep 19 12:01:57.039822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1823/3673] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:56 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:58.065262 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:58.065860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:58.073189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:58.073676 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:58.074116 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:58.074810 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:58.075290 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:58.075755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:58.205940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:58.214450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:58.215951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:58.217117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-70b170b3-0bca-45b4-8693-b729fe998ae1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1672 microversion: 2.20 time: 0.155798 Sep 19 12:01:58.217728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1851/3674] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:58 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1672 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:01:59.244348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:01:59.245037 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:01:59.251636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:59.252122 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:59.252561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:59.253252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:01:59.253712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:01:59.254133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:01:59.632159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:59.640521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:59.641956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:01:59.643129 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-849e4fee-3312-4587-83ac-d494056c6469 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1672 microversion: 2.20 time: 0.403582 Sep 19 12:01:59.643716 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1824/3675] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:01:59 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1672 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:00.669074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:00.670205 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:00.678009 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:00.678716 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:00.679316 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:00.680288 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:00.681039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:00.681913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:00.936477 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:00.946170 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:00.968029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:00.968029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-0e8b3355-ffa0-42ca-a6fe-418696e5dde2 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.294603 Sep 19 12:02:00.968029 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1852/3676] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:00 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:01.992147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:01.992878 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:01.999484 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:02.000238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:02.000847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:02.001958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:02.002587 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:02.003321 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:02.171663 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:02.180340 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:02.181789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:02.182965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-875c02cb-4ad9-4e53-a28a-ad7aaa5c0a7e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.195589 Sep 19 12:02:02.183735 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1825/3677] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:01 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:02:03.212250 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:03.213016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:03.221210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:03.222091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:03.222917 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:03.224234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:03.224924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:03.225581 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:03.401779 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:03.415347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:03.419158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:03.419158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-837bcceb-d7d5-4b3c-aabe-d600ff926973 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.211509 Sep 19 12:02:03.419158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1853/3678] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:03 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:04.449132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:04.449649 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:04.456416 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:04.457048 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:04.457568 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:04.458277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:04.458945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:04.460378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:04.628207 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:04.637438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:04.638640 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:04.639836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c80aae41-3a6c-477c-8df4-1a6825850d10 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.194709 Sep 19 12:02:04.640917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1826/3679] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:04 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:05.667078 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:05.668035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:05.675110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:05.676100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:05.677334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:05.678342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:05.679002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:05.679741 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:05.837144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:05.846142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:05.847706 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:05.848879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e515e2a-f1f2-4814-8c1d-f21a9cac045e tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.186462 Sep 19 12:02:05.849442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1854/3680] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:05 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:06.886559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:06.886559 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:06.896847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:06.904849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:06.904849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:06.904849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:06.904849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:06.905260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:07.098438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:07.121278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:07.124035 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:07.126906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-918b236e-cc5e-49c9-bf11-4488a7d60b31 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.254207 Sep 19 12:02:07.131572 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1827/3681] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:06 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:08.154851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:08.155412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:08.162463 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:08.163540 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:08.163970 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:08.164685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:08.165145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:08.165577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:08.337919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:08.348522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:08.350209 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:08.359309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-42d07d1b-7998-4543-8ef0-5ec3422973d9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.202347 Sep 19 12:02:08.359309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1855/3682] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:08 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:09.384736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:09.385362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:09.393056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:09.393547 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:09.393986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:09.394952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:09.395432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:09.395952 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:09.554528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:09.566317 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:09.568078 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:09.570383 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aeb6d4fc-04cf-448c-a037-aba8e9009dec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.192671 Sep 19 12:02:09.571436 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1828/3683] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:09 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:02:10.596796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:10.597403 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:10.604062 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:10.604641 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:10.605086 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:10.605780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:10.606229 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:10.606649 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:10.745542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:10.753709 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:10.755186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:10.756352 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d48fd2da-ffc1-45e2-9d94-50baca5756b7 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.163547 Sep 19 12:02:10.756910 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1856/3684] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:10 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:11.782723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:11.783385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:11.786364 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=40,nova_api:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:11.791579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:11.792070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:11.792512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:11.793242 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:11.793706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:11.794132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:11.926617 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:11.936965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:11.938474 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:11.939675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fb990d13-68b9-4022-b14d-78139be39e07 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.160865 Sep 19 12:02:11.942150 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1829/3685] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:11 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:12.968177 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:12.968813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:12.971338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=36 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:12.976805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:12.981225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:12.981225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:12.981225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:12.981225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:12.981645 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:13.117946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:13.129132 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:13.130599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:13.131801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a25b39f6-b06c-42b7-b492-61853b6f25b6 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.167624 Sep 19 12:02:13.132896 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1857/3686] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:12 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:14.158330 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:14.158946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:14.166665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:14.167151 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:14.167684 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:14.168378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:14.168838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:14.169357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:14.317401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:14.327664 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:14.330558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:14.331543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a6d051e8-8ac3-4210-982e-3f6fc051d6ec tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.177078 Sep 19 12:02:14.332338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1830/3687] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:14 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:02:15.360377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:15.360891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:15.367311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:15.367837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:15.368277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:15.368966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:15.369417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:15.369850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:15.513302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:15.524255 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:15.525880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:15.527111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5f5a2512-cb1e-43ee-9b59-3c3ab324a566 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.170727 Sep 19 12:02:15.530571 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1858/3688] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:15 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:16.740588 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:16.741743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:16.748132 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:16.748616 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:16.749057 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:16.749749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:16.750203 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:16.750680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:16.885359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:16.894726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:16.896230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:16.897777 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-107c8b47-76d7-4c06-9093-d7b0135cf783 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.348978 Sep 19 12:02:16.907757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1831/3689] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:16 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:17.081562 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-8146abda-6591-42f2-b086-70afbecee739 req-25bdc41c-a350-44f0-890b-f75ba75583a7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f828522-227a-4ba6-828a-ddfce72850e0", "name": "network-vif-plugged", "status": "completed", "tag": "acf38022-7de3-46c1-8bfb-c9b18c3f57a0"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:17.091509 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8146abda-6591-42f2-b086-70afbecee739 req-25bdc41c-a350-44f0-890b-f75ba75583a7 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:17.091848 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8146abda-6591-42f2-b086-70afbecee739 req-25bdc41c-a350-44f0-890b-f75ba75583a7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:17.092279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-8146abda-6591-42f2-b086-70afbecee739 req-25bdc41c-a350-44f0-890b-f75ba75583a7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:17.094900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:17.105032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-8146abda-6591-42f2-b086-70afbecee739 req-25bdc41c-a350-44f0-890b-f75ba75583a7 service nova] Creating event network-vif-plugged:acf38022-7de3-46c1-8bfb-c9b18c3f57a0 for instance 9f828522-227a-4ba6-828a-ddfce72850e0 on hv-cinder-82282 Sep 19 12:02:17.110553 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-8146abda-6591-42f2-b086-70afbecee739 req-25bdc41c-a350-44f0-890b-f75ba75583a7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032795 Sep 19 12:02:17.111159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1859/3690] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:02:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:17.925510 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:17.926162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:17.936871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:17.936871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:17.936871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:17.936871 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:17.937411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:17.937411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:18.112830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:18.122261 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:18.123726 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:18.124918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8b7a2c1c-59c8-45bc-8e89-d0a285e46602 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.204647 Sep 19 12:02:18.125494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1832/3691] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:17 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 19 12:02:19.153402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:19.154023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:19.160500 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:19.160985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:19.161436 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:19.162129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:19.162586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:19.163017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:19.308282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:19.316770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:19.318212 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:19.322921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-d7c2057a-939a-4b91-8e44-7d4831dd038d tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1730 microversion: 2.20 time: 0.171671 Sep 19 12:02:19.322921 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1860/3692] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:19 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1730 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:20.346365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:20.347063 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:20.354106 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:20.354680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:20.355204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:20.355889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:20.356338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:20.356761 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:20.494067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:20.502448 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:20.504086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:20.505196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4fb9e885-4512-4a66-a57c-5d60b55ccc16 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1717 microversion: 2.20 time: 0.162783 Sep 19 12:02:20.505756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1833/3693] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:20 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:24.375318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:24.375905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:24.383350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.389723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.389723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.389723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.389723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.390083 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.410793 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-25b111ce-77fd-45a7-ae91-276831c3ee1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229/ips" status: 200 len: 149 microversion: 2.1 time: 0.039267 Sep 19 12:02:24.411398 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1861/3694] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 12:02:24 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:24.424217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fa67850f-d817-4089-9ef8-cb82df1990d3"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:24.426703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:24.433944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.434423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.434857 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.435569 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.436026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.436434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.438906 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:24.515669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Invalid volume: volume fa67850f-d817-4089-9ef8-cb82df1990d3 is already attached to instances: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: POST /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229/os-volume_attachments HTTP/1.1 Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 74 Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:02:24.517494 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {"volumeAttachment": {"volumeId": "fa67850f-d817-4089-9ef8-cb82df1990d3"}} Sep 19 12:02:24.519029 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Invalid volume: volume fa67850f-d817-4089-9ef8-cb82df1990d3 is already attached to instances: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'server_id': 'dd02539b-f152-4db4-be5d-25c9d87db229', 'body': {'volumeAttachment': {'volumeId': 'fa67850f-d817-4089-9ef8-cb82df1990d3'}}} Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume fa67850f-d817-4089-9ef8-cb82df1990d3 is already attached to instances: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:24.530847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume fa67850f-d817-4089-9ef8-cb82df1990d3 is already attached to instances: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:24.532091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume fa67850f-d817-4089-9ef8-cb82df1990d3 is already attached to instances: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 400 to user: Invalid volume: volume fa67850f-d817-4089-9ef8-cb82df1990d3 is already attached to instances: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c01363ae-36f4-4ed1-9778-ef420f5545e9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.099339 Sep 19 12:02:24.533304 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1834/3695] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 12:02:24 2022] POST /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229/os-volume_attachments => generated 174 bytes in 101 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 19 12:02:24.533828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:24.533828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:24.534364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.534905 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.535349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.536035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.536527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.536955 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.563206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:02:24.875101 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5281fb88-96a3-427a-83b9-d69b60614c72 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 204 len: 0 microversion: 2.1 time: 0.350716 Sep 19 12:02:24.875904 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1862/3696] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:02:24 2022] DELETE /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 19 12:02:24.887050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:24.887686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:24.894124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.894866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.895323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:24.896362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:24.896612 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:24.897105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:25.033410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:25.047451 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c99b7b7e-a80e-4e22-a462-a12a559bcd7c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1681 microversion: 2.1 time: 0.164436 Sep 19 12:02:25.048040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1835/3697] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:24 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1681 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:26.073334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:26.074033 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:26.080765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:26.081247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:26.081713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:26.082404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:26.082860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:26.083323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:26.219300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:26.227442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a164471e-6572-48fc-95dc-4c5bcc5743a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1681 microversion: 2.1 time: 0.159002 Sep 19 12:02:26.228017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1863/3698] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:26 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:27.252604 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:27.253329 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:27.260149 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:27.260567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:27.261009 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:27.261701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:27.262215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:27.262643 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:27.356352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:27.364423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-00c7f05f-4df6-405a-ac6a-9c28e2f99f89 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1614 microversion: 2.1 time: 0.116292 Sep 19 12:02:27.365444 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1836/3699] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:27 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1614 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:27.572614 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-384b6c83-19bc-4cf2-8856-6fe49a79c5a9 req-689e46c2-6d86-4d71-9d46-c553f778c27f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd02539b-f152-4db4-be5d-25c9d87db229", "name": "network-vif-deleted", "tag": "fe6538b7-4b97-4147-a20d-a470063baeb6"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:27.583259 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-384b6c83-19bc-4cf2-8856-6fe49a79c5a9 req-689e46c2-6d86-4d71-9d46-c553f778c27f service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:27.583738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-384b6c83-19bc-4cf2-8856-6fe49a79c5a9 req-689e46c2-6d86-4d71-9d46-c553f778c27f service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:27.585206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-384b6c83-19bc-4cf2-8856-6fe49a79c5a9 req-689e46c2-6d86-4d71-9d46-c553f778c27f service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:27.595590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-384b6c83-19bc-4cf2-8856-6fe49a79c5a9 req-689e46c2-6d86-4d71-9d46-c553f778c27f service nova] Creating event network-vif-deleted:fe6538b7-4b97-4147-a20d-a470063baeb6 for instance dd02539b-f152-4db4-be5d-25c9d87db229 on hv-cinder-82282 Sep 19 12:02:27.600843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-384b6c83-19bc-4cf2-8856-6fe49a79c5a9 req-689e46c2-6d86-4d71-9d46-c553f778c27f service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032015 Sep 19 12:02:27.602191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1864/3700] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:02:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:28.389288 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:28.390089 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:28.396958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:28.397435 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:28.398483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:28.399243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:28.399681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:28.400101 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:28.468560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:28.476737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a386c276-081e-4526-9c16-c408847927cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1614 microversion: 2.1 time: 0.091285 Sep 19 12:02:28.477320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1837/3701] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:28 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1614 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:29.502164 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:29.502866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:29.509944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:29.510434 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:29.510876 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:29.511596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:29.512063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:29.512488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:29.575626 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:29.583242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-539a578e-cfd8-4a71-9407-e6f63de7e8a0 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 200 len: 1327 microversion: 2.1 time: 0.085868 Sep 19 12:02:29.583819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1865/3702] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:29 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 1327 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:30.605986 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:30.606598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:30.613072 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:30.613560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:30.615251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:30.615251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:30.615251 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:30.615698 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:30.631556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 HTTP/1.1 Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:02:30.633743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:02:30.635139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': 'dd02539b-f152-4db4-be5d-25c9d87db229'} Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:02:30.635935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:02:30.637422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:30.638551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:02:30.638551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e6f59f4-587b-40de-9381-96c1fae971df tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 404 len: 111 microversion: 2.1 time: 0.033407 Sep 19 12:02:30.638551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1838/3703] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:30 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:02:30.644939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6a998d8f-f2f3-4492-ba4e-dece4f877280 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '.version_select at 0x7f4b9a26c3a0>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:30.710432 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6a998d8f-f2f3-4492-ba4e-dece4f877280 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683104908" status: 202 len: 0 microversion: 2.1 time: 0.069759 Sep 19 12:02:30.711673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1866/3704] 10.222.0.78 () {58 vars in 1221 bytes} [Mon Sep 19 12:02:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1683104908 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 19 12:02:31.601316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:31.601802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:31.607858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.608446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.608760 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.609446 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.609898 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.610323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.690493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lazy-loading 'services' on Instance uuid f2c0e76f-dae0-4337-bc81-8d5def6ea5bd {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:02:31.944708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-70c1d9b2-1916-4836-b743-b59fdebbc1e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments/fa67850f-d817-4089-9ef8-cb82df1990d3" status: 202 len: 0 microversion: 2.1 time: 0.347009 Sep 19 12:02:31.945307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1839/3705] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 12:02:31 2022] DELETE /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments/fa67850f-d817-4089-9ef8-cb82df1990d3 => generated 0 bytes in 349 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:02:31.954341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:31.956740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:31.963608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.964160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.964698 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.965400 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:31.970342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:31.970342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:31.997492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-60df85ce-1ac1-4665-9116-c01d899fd46d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047691 Sep 19 12:02:31.998072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1867/3706] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 12:02:31 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:33.011092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:33.013567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:33.020139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.020618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.021047 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.021729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.022173 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.022609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.053711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3bf149be-9daf-45d8-a39a-a647dc3df9e1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047381 Sep 19 12:02:33.054271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1840/3707] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 12:02:33 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:02:33.121596 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:33.122089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:33.128580 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.129055 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.129492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.130176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.130633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.131275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.163650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:02:33.568437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eb4e822f-a19d-484c-a77e-a874d3313424 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 204 len: 0 microversion: 2.1 time: 0.450377 Sep 19 12:02:33.569038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1868/3708] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:02:33 2022] DELETE /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:02:33.584984 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:33.585601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:33.592749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.593245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.593688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.594388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:33.594910 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:33.595396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:33.731553 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:33.739396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b8dc182f-02b0-49a2-84d5-d201e5410d5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1682 microversion: 2.1 time: 0.159795 Sep 19 12:02:33.739969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1841/3709] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:33 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:34.764841 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:34.765539 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:34.772349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:34.772819 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:34.773245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:34.773928 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:34.774376 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:34.774796 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:34.905167 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:34.912946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8336c74a-19da-43d4-a868-aad5703f46d1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1682 microversion: 2.1 time: 0.152990 Sep 19 12:02:34.921794 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1869/3710] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:34 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:35.938480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:35.939415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:35.946165 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:35.946651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:35.947091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:35.947822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:35.948282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:35.949483 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:36.059062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:36.067135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-954d9ef4-be0f-473a-8405-32fee5b4a5ce tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1615 microversion: 2.1 time: 0.132896 Sep 19 12:02:36.067831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1842/3711] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:35 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1615 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:36.452125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-0cd1733b-f313-4c34-b6e2-03d049bd2bda req-3f7e9d2c-cffc-49fd-8365-b19122618da6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f2c0e76f-dae0-4337-bc81-8d5def6ea5bd", "name": "network-vif-deleted", "tag": "5ae18733-17b4-4ae7-bf79-00e2dd5a8e30"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:36.485627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-0cd1733b-f313-4c34-b6e2-03d049bd2bda req-3f7e9d2c-cffc-49fd-8365-b19122618da6 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:36.486119 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-0cd1733b-f313-4c34-b6e2-03d049bd2bda req-3f7e9d2c-cffc-49fd-8365-b19122618da6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:36.486556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-0cd1733b-f313-4c34-b6e2-03d049bd2bda req-3f7e9d2c-cffc-49fd-8365-b19122618da6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:36.514999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-0cd1733b-f313-4c34-b6e2-03d049bd2bda req-3f7e9d2c-cffc-49fd-8365-b19122618da6 service nova] Creating event network-vif-deleted:5ae18733-17b4-4ae7-bf79-00e2dd5a8e30 for instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd on hv-cinder-82282 Sep 19 12:02:36.521611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-0cd1733b-f313-4c34-b6e2-03d049bd2bda req-3f7e9d2c-cffc-49fd-8365-b19122618da6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.227003 Sep 19 12:02:36.522275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1870/3712] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:02:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:37.090798 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:37.091466 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:37.099807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:37.100703 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:37.101739 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:37.103014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:37.104445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:37.105230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:37.143763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:37.143763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:37.144260 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:37.144804 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lazy-loading 'fault' on Instance uuid f2c0e76f-dae0-4337-bc81-8d5def6ea5bd {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:02:37.189467 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:37.197725 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dffa426e-a796-4af2-9478-8acfb9f79028 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 200 len: 1332 microversion: 2.1 time: 0.111328 Sep 19 12:02:37.198367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1843/3713] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:37 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 1332 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:38.225416 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:38.226137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:38.232456 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:38.232940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:38.233378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:38.234248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:38.234702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:38.235129 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:38.249099 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd HTTP/1.1 Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:02:38.250765 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:02:38.257112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': 'f2c0e76f-dae0-4337-bc81-8d5def6ea5bd'} Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:02:38.257770 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:02:38.258754 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:02:38.259667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:02:38.259667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-49641108-f290-46bb-8c32-616d0d7b9403 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 404 len: 111 microversion: 2.1 time: 0.031636 Sep 19 12:02:38.259667 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1871/3714] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:38 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:02:38.261839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-d1bc253c-5e99-41e2-aad5-21e21fbf07d7 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '.version_select at 0x7f4b9a915a60>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:38.369828 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-d1bc253c-5e99-41e2-aad5-21e21fbf07d7 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150126440" status: 202 len: 0 microversion: 2.1 time: 0.111952 Sep 19 12:02:38.370423 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1844/3715] 10.222.0.78 () {58 vars in 1221 bytes} [Mon Sep 19 12:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1150126440 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:02:39.505918 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-71a9fa7f-3989-4fd1-a838-42cc33258d8f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: .version_select at 0x7f4b9a759af0>, body: {"keypair": {"name": "tempest-keypair-1607079115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIFlzXttX+nou3erI+5msGtzhIUSe5D6akz/omCstApEthMuePpiE9EF9nk0AgXcR43Sn8gusgNWvTkBbmKC4dxukxUy9hddmaA+c9csNqbmKPV659/EJ8DI0184yBOhtg=="}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:39.521440 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-71a9fa7f-3989-4fd1-a838-42cc33258d8f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:02:39.525364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-71a9fa7f-3989-4fd1-a838-42cc33258d8f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:02:39.636348 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-71a9fa7f-3989-4fd1-a838-42cc33258d8f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.134127 Sep 19 12:02:39.636873 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1872/3716] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 12:02:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:42.394408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1511652602", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73bc4776-a82b-41a8-8ce8-a6075f380581"}], "security_groups": [{"name": "tempest-securitygroup--1586380716"}], "key_name": "tempest-keypair-1607079115", "user_data": "}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:42.498680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] validate_networks() for [('73bc4776-a82b-41a8-8ce8-a6075f380581', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:02:42.957917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:02:42.958459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:02:42.958938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:02:42.959373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:02:42.959786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:02:42.969125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:42.969593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:42.970018 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:42.970731 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:42.971191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:42.975605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:42.988408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:02:42.992274 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:02:43.003509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:02:43.005759 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:02:43.143400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-aa2ca542-e219-4ba6-a267-5208a8e55b85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.754464 Sep 19 12:02:43.150561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1845/3717] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 12:02:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 756 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:02:43.157162 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-af79ffb7-53e1-4999-aa66-6fabe660e2ef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:43.157856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-af79ffb7-53e1-4999-aa66-6fabe660e2ef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:43.159936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=52,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:43.224834 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-af79ffb7-53e1-4999-aa66-6fabe660e2ef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:43.238689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-af79ffb7-53e1-4999-aa66-6fabe660e2ef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1242 microversion: 2.1 time: 0.082770 Sep 19 12:02:43.238689 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1873/3718] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:43 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:44.258481 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:44.264757 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:44.265967 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:44.266456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:44.267000 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:44.267756 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:44.268195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:44.268868 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:44.332853 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:44.340711 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e841dd79-c482-4738-a9b5-412742fead21 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1246 microversion: 2.1 time: 0.086685 Sep 19 12:02:44.341294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1846/3719] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:44 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:45.364285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:45.364936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:45.371950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:45.372439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:45.372892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:45.373590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:45.374047 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:45.374481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:45.455696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:45.464938 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cdf9a3e0-9f13-4ebb-977e-05f86511d3ea tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1302 microversion: 2.1 time: 0.104960 Sep 19 12:02:45.465585 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1874/3720] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:45 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1302 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:46.488422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:46.488946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:46.495606 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:46.496086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:46.496536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:46.497223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:46.497683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:46.498110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:46.724613 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:46.733246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f5acb90b-a56f-4c4b-837a-4e6c67aac90a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1368 microversion: 2.1 time: 0.248844 Sep 19 12:02:46.733833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1847/3721] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:46 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:47.287195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-5d0f736c-291d-4867-9931-4a6e1f57af91 req-a0db2fb1-ee60-4081-9209-1885563080c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e6420b-534f-452d-ac8c-bd3ade221193", "tag": "f4375fc8-9a75-4062-8f18-a5d051eefc75"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:47.298046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-5d0f736c-291d-4867-9931-4a6e1f57af91 req-a0db2fb1-ee60-4081-9209-1885563080c9 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:47.298646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-5d0f736c-291d-4867-9931-4a6e1f57af91 req-a0db2fb1-ee60-4081-9209-1885563080c9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:47.299203 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-5d0f736c-291d-4867-9931-4a6e1f57af91 req-a0db2fb1-ee60-4081-9209-1885563080c9 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:47.312370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-5d0f736c-291d-4867-9931-4a6e1f57af91 req-a0db2fb1-ee60-4081-9209-1885563080c9 service nova] Creating event network-changed:f4375fc8-9a75-4062-8f18-a5d051eefc75 for instance 99e6420b-534f-452d-ac8c-bd3ade221193 on hv-cinder-82282 Sep 19 12:02:47.317758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-5d0f736c-291d-4867-9931-4a6e1f57af91 req-a0db2fb1-ee60-4081-9209-1885563080c9 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034847 Sep 19 12:02:47.318525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1875/3722] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:02:47.758583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:47.759404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:47.762937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:47.767924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:47.768415 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:47.769124 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:47.769826 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:47.770286 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:47.770842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:47.971070 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:47.981307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07b76cb4-8c17-41e5-8cbe-f83a55481a90 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1368 microversion: 2.1 time: 0.226762 Sep 19 12:02:47.981894 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1848/3723] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:47 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:49.007126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:49.007844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:49.015708 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:49.016189 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:49.016697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:49.017409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:49.017856 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:49.018280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:49.157965 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:49.167025 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b5f051de-2e71-4739-89c8-53430c136a34 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1368 microversion: 2.1 time: 0.164651 Sep 19 12:02:49.167979 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1876/3724] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:49 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:50.198511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:50.199116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:50.206845 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:50.207375 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:50.207818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:50.208495 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:50.208945 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:50.209362 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:50.345162 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:50.352973 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-83f5e1c4-3247-4a37-b93a-0154a69a64a9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1368 microversion: 2.1 time: 0.159026 Sep 19 12:02:50.353575 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1849/3725] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:50 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1368 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:51.376323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:51.376960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:51.383729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:51.384204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:51.385147 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:51.385869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:51.386675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:51.391437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:51.391437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:51.528985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:51.536843 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-de412619-7505-4b86-a0d6-01d043ad096e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1368 microversion: 2.1 time: 0.164727 Sep 19 12:02:51.537422 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1877/3726] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:51 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:51.826538 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-b96d6c1a-de6a-4615-a0cb-7d56bb39fe44 req-79d41754-acbe-4cd8-b75d-99f990c66ec6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e6420b-534f-452d-ac8c-bd3ade221193", "name": "network-vif-plugged", "status": "completed", "tag": "f4375fc8-9a75-4062-8f18-a5d051eefc75"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:51.838896 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-b96d6c1a-de6a-4615-a0cb-7d56bb39fe44 req-79d41754-acbe-4cd8-b75d-99f990c66ec6 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:51.839476 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-b96d6c1a-de6a-4615-a0cb-7d56bb39fe44 req-79d41754-acbe-4cd8-b75d-99f990c66ec6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:51.839838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-b96d6c1a-de6a-4615-a0cb-7d56bb39fe44 req-79d41754-acbe-4cd8-b75d-99f990c66ec6 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:51.851391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-b96d6c1a-de6a-4615-a0cb-7d56bb39fe44 req-79d41754-acbe-4cd8-b75d-99f990c66ec6 service nova] Creating event network-vif-plugged:f4375fc8-9a75-4062-8f18-a5d051eefc75 for instance 99e6420b-534f-452d-ac8c-bd3ade221193 on hv-cinder-82282 Sep 19 12:02:51.857659 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-b96d6c1a-de6a-4615-a0cb-7d56bb39fe44 req-79d41754-acbe-4cd8-b75d-99f990c66ec6 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035465 Sep 19 12:02:51.858256 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1850/3727] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:02:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:02:52.559279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:52.559874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:52.566798 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:52.567311 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:52.567748 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:52.568435 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:52.568883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:52.569307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:52.699598 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:52.707287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9b497fb6-9a49-4519-bf1b-65a56ca053d8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1368 microversion: 2.1 time: 0.151854 Sep 19 12:02:52.707857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1878/3728] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:52 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:53.727951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:53.729380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:53.733646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:53.734378 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:53.740633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.741119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.741560 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:53.742273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.742728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.743154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:53.887840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:53.897947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-76e7235b-c1df-4275-ae77-21c6fb966bee tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1368 microversion: 2.1 time: 0.171649 Sep 19 12:02:53.898883 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1851/3729] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:53 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:53.906768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:53.909837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:53.919582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:53.925183 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.926001 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.926718 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:53.928261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:53.928799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:53.929292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:53.969880 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f8c58d36-9cbc-4a17-8a5a-12dd285e264a tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.067725 Sep 19 12:02:53.970473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1879/3730] 10.222.0.78 () {60 vars in 1343 bytes} [Mon Sep 19 12:02:53 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:02:54.039425 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:54.040002 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:54.047982 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.048473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.048916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.049618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.053641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.053641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.076365 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:02:54.080019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:02:54.448026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-48499e63-59ba-4ff6-a988-c6cc028c5fd1 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 204 len: 0 microversion: 2.20 time: 0.411802 Sep 19 12:02:54.448636 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1852/3731] 10.222.0.78 () {60 vars in 1280 bytes} [Mon Sep 19 12:02:54 2022] DELETE /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:02:54.458452 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:54.459191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:54.466747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.467289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.467728 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.468417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.468879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.469298 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.628194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:54.639656 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:54.641110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:54.642483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9118e6f0-cfdd-4719-8a6e-553a254f5ffc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.188700 Sep 19 12:02:54.643054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1880/3732] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:54 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:54.937022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:54.937723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:54.946610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.947119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.947593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:54.948308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:54.948766 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:54.949198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.085086 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:55.093598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0fa56adc-e56a-4045-b8b0-be51d63a753e tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1558 microversion: 2.1 time: 0.161029 Sep 19 12:02:55.094180 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1853/3733] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:02:54 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1558 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:02:55.117402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:55.117944 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:55.125545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.126038 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.126478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.127204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.127672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.128106 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.210616 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-c1a0491e-be8f-40ad-8de4-bf86b12af8e5 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097203 Sep 19 12:02:55.211310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1881/3734] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 12:02:55 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:55.669661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:55.670642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:55.677064 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.677672 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.678352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.679054 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:55.679610 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:55.680105 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:55.854661 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:55.864939 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:55.865411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:55.866678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-8d34ed60-ed90-4eae-9fc5-45bae4b7e18c tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.201068 Sep 19 12:02:55.867273 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1854/3735] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:55 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:56.896119 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-2ad20309-5223-46e7-88da-8d478b4d7901 req-a5e93266-f5ac-4af4-a2be-b1af9cbdfa71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e6420b-534f-452d-ac8c-bd3ade221193", "tag": "f4375fc8-9a75-4062-8f18-a5d051eefc75"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:56.896786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:56.897133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:56.905534 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:56.906037 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:56.906481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:56.907397 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:56.908032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:56.908537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:56.916586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-2ad20309-5223-46e7-88da-8d478b4d7901 req-a5e93266-f5ac-4af4-a2be-b1af9cbdfa71 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:56.922390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-2ad20309-5223-46e7-88da-8d478b4d7901 req-a5e93266-f5ac-4af4-a2be-b1af9cbdfa71 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:56.922390 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-2ad20309-5223-46e7-88da-8d478b4d7901 req-a5e93266-f5ac-4af4-a2be-b1af9cbdfa71 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:56.934933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-2ad20309-5223-46e7-88da-8d478b4d7901 req-a5e93266-f5ac-4af4-a2be-b1af9cbdfa71 service nova] Creating event network-changed:f4375fc8-9a75-4062-8f18-a5d051eefc75 for instance 99e6420b-534f-452d-ac8c-bd3ade221193 on hv-cinder-82282 Sep 19 12:02:56.942504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-2ad20309-5223-46e7-88da-8d478b4d7901 req-a5e93266-f5ac-4af4-a2be-b1af9cbdfa71 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051311 Sep 19 12:02:56.943843 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1855/3736] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:02:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:02:57.119583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:57.130287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:57.133644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:57.133960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3addfdb2-b4c0-41bd-b114-3a9bc4444e23 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1723 microversion: 2.20 time: 0.243973 Sep 19 12:02:57.135239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1882/3737] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:56 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1723 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:58.165152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:58.166025 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:58.173011 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.173729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.174339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.175232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.176141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.176674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.217148 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.217629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.218062 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.218508 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lazy-loading 'fault' on Instance uuid 9f828522-227a-4ba6-828a-ddfce72850e0 {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:02:58.262307 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:58.271647 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:58.273354 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '5a8fb193bdd1448eab774bd1eef437c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ddce6e2bc7841d495afa07655d7d25f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:02:58.274542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4cdc9869-c0f4-4ce7-8745-5d3b0f900fa9 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 200 len: 1371 microversion: 2.20 time: 0.114774 Sep 19 12:02:58.275108 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1856/3738] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:58 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 1371 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 19 12:02:58.958145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-2296111a-a6c7-4bf0-8d61-64e63734f834 req-e6ea40ab-da82-4f57-80da-8f5672af282a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9f828522-227a-4ba6-828a-ddfce72850e0", "name": "network-vif-deleted", "tag": "acf38022-7de3-46c1-8bfb-c9b18c3f57a0"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:02:58.968561 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-2296111a-a6c7-4bf0-8d61-64e63734f834 req-e6ea40ab-da82-4f57-80da-8f5672af282a service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:58.969060 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-2296111a-a6c7-4bf0-8d61-64e63734f834 req-e6ea40ab-da82-4f57-80da-8f5672af282a service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:58.969486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-2296111a-a6c7-4bf0-8d61-64e63734f834 req-e6ea40ab-da82-4f57-80da-8f5672af282a service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:58.981495 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-2296111a-a6c7-4bf0-8d61-64e63734f834 req-e6ea40ab-da82-4f57-80da-8f5672af282a service nova] Creating event network-vif-deleted:acf38022-7de3-46c1-8bfb-c9b18c3f57a0 for instance 9f828522-227a-4ba6-828a-ddfce72850e0 on hv-cinder-82282 Sep 19 12:02:58.986957 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-2296111a-a6c7-4bf0-8d61-64e63734f834 req-e6ea40ab-da82-4f57-80da-8f5672af282a service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Sep 19 12:02:58.987615 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1883/3739] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:02:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:02:59.302050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:59.302655 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:02:59.309094 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:59.309577 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:59.310016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:59.310728 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:02:59.311189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:02:59.311627 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:02:59.324705 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] HTTP exception thrown: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Request method failure captured: Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 HTTP/1.1 Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFIG6P53Ug06LyU6GtPkbNhm6HkZPcfQTXVnnbHhBu_lOdIKyR3dGzVIs1zUliEmM2qsFTuaUnUMQsw_UdRqfD3-TxmmZkLH-lbgCyhhqvrzSYBQSh3mjd7f7wIOOjZBnZxsTGDIY9mS7A2V5DbiEsMtcLicFXDQbHFGEKhjryl_Orw Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:02:59.326381 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 5a8fb193bdd1448eab774bd1eef437c9 Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:02:59.328367 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '9f828522-227a-4ba6-828a-ddfce72850e0'} Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:02:59.329319 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:02:59.330639 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:02:59.331924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Returning 404 to user: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:02:59.331924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b63b2423-c5f1-4fe1-a6be-fc83df2daeef tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 404 len: 111 microversion: 2.20 time: 0.029636 Sep 19 12:02:59.331924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1857/3740] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:02:59 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:02:59.337345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-139fe1a9-4561-4964-b2e7-38cf212e8093 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '.version_select at 0x7f4b9a761790>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:02:59.442809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-139fe1a9-4561-4964-b2e7-38cf212e8093 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936922600" status: 204 len: 0 microversion: 2.20 time: 0.109622 Sep 19 12:02:59.443441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1884/3741] 10.222.0.78 () {60 vars in 1262 bytes} [Mon Sep 19 12:02:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1936922600 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 19 12:03:01.565016 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:01.566267 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:01.572907 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.573414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.573846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.574524 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.575551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.576145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.589911 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] HTTP exception thrown: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Request method failure captured: Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 HTTP/1.1 Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFIG6P53Ug06LyU6GtPkbNhm6HkZPcfQTXVnnbHhBu_lOdIKyR3dGzVIs1zUliEmM2qsFTuaUnUMQsw_UdRqfD3-TxmmZkLH-lbgCyhhqvrzSYBQSh3mjd7f7wIOOjZBnZxsTGDIY9mS7A2V5DbiEsMtcLicFXDQbHFGEKhjryl_Orw Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:03:01.591523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 5a8fb193bdd1448eab774bd1eef437c9 Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.592954 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '9f828522-227a-4ba6-828a-ddfce72850e0'} Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:03:01.593678 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.594680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.595746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Returning 404 to user: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:03:01.595746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ab4024dc-1eef-4722-9afc-531ee0d1b132 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 404 len: 111 microversion: 2.20 time: 0.032165 Sep 19 12:03:01.595746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1858/3742] 10.222.0.78 () {60 vars in 1280 bytes} [Mon Sep 19 12:03:01 2022] DELETE /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:03:01.603945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:01.604801 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: 9f828522-227a-4ba6-828a-ddfce72850e0] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:01.611753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.619946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.619946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.619946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:01.619946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:01.620406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:01.631511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] HTTP exception thrown: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Request method failure captured: Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 HTTP/1.1 Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFIG6P53Ug06LyU6GtPkbNhm6HkZPcfQTXVnnbHhBu_lOdIKyR3dGzVIs1zUliEmM2qsFTuaUnUMQsw_UdRqfD3-TxmmZkLH-lbgCyhhqvrzSYBQSh3mjd7f7wIOOjZBnZxsTGDIY9mS7A2V5DbiEsMtcLicFXDQbHFGEKhjryl_Orw Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:03:01.633225 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 5a8fb193bdd1448eab774bd1eef437c9 Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.634604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '9f828522-227a-4ba6-828a-ddfce72850e0'} Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:03:01.635338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. Sep 19 12:03:01.636550 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:01.638232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Returning 404 to user: Instance 9f828522-227a-4ba6-828a-ddfce72850e0 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:03:01.638232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8aca6deb-1d02-4066-8251-c669000ca4b4 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0" status: 404 len: 111 microversion: 2.20 time: 0.036699 Sep 19 12:03:01.638232 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1885/3743] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:03:01 2022] GET /compute/v2.1/servers/9f828522-227a-4ba6-828a-ddfce72850e0 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:03:02.882747 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:02.883266 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:02.890674 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.891159 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.891635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.892328 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.892788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.893477 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.906787 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] HTTP exception thrown: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Request method failure captured: Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c HTTP/1.1 Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFIG6P53Ug06LyU6GtPkbNhm6HkZPcfQTXVnnbHhBu_lOdIKyR3dGzVIs1zUliEmM2qsFTuaUnUMQsw_UdRqfD3-TxmmZkLH-lbgCyhhqvrzSYBQSh3mjd7f7wIOOjZBnZxsTGDIY9mS7A2V5DbiEsMtcLicFXDQbHFGEKhjryl_Orw Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:03:02.908357 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 5a8fb193bdd1448eab774bd1eef437c9 Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.909738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': 'e7226154-6dfa-424f-b89e-fb320490d32c'} Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:03:02.910552 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.911949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.913359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Returning 404 to user: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:03:02.913359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1650fcf8-19e6-4463-8c67-7b43d0a19615 tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "DELETE /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 404 len: 111 microversion: 2.20 time: 0.030876 Sep 19 12:03:02.913359 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1859/3744] 10.222.0.78 () {60 vars in 1280 bytes} [Mon Sep 19 12:03:02 2022] DELETE /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:03:02.918176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:02.918780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] [instance: e7226154-6dfa-424f-b89e-fb320490d32c] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:02.925105 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.925582 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.926012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.926688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:02.927136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:02.927583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:02.941280 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] HTTP exception thrown: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Request method failure captured: Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c HTTP/1.1 Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFIG6P53Ug06LyU6GtPkbNhm6HkZPcfQTXVnnbHhBu_lOdIKyR3dGzVIs1zUliEmM2qsFTuaUnUMQsw_UdRqfD3-TxmmZkLH-lbgCyhhqvrzSYBQSh3mjd7f7wIOOjZBnZxsTGDIY9mS7A2V5DbiEsMtcLicFXDQbHFGEKhjryl_Orw Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Openstack-Nova-Api-Version: 2.20 Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:03:02.942814 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/0ddce6e2bc7841d495afa07655d7d25f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: 0ddce6e2bc7841d495afa07655d7d25f Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1281350293 Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 5a8fb193bdd1448eab774bd1eef437c9 Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1281350293-project Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.944243 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': 'e7226154-6dfa-424f-b89e-fb320490d32c'} Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:03:02.945017 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. Sep 19 12:03:02.946213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:03:02.947347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] Returning 404 to user: Instance e7226154-6dfa-424f-b89e-fb320490d32c could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:03:02.947347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-311dc143-195f-4b5c-a2ef-7f1176fe51dc tempest-AttachVolumeShelveTestJSON-1281350293 tempest-AttachVolumeShelveTestJSON-1281350293-project] 10.222.0.78 "GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c" status: 404 len: 111 microversion: 2.20 time: 0.029875 Sep 19 12:03:02.947347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1886/3745] 10.222.0.78 () {60 vars in 1277 bytes} [Mon Sep 19 12:03:02 2022] GET /compute/v2.1/servers/e7226154-6dfa-424f-b89e-fb320490d32c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:03:33.255919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:33.256414 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:33.258740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:33.259511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:33.264196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:33.264690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:33.265128 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:33.265830 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:33.266287 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:33.266723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:33.290972 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c8ae11a6-55f5-4ba1-9aa9-0b34fc88ffef tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/ips" status: 200 len: 150 microversion: 2.1 time: 0.039096 Sep 19 12:03:33.291594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1860/3746] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 12:03:33 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:03:34.952385 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aec618f0-9e30-4566-8f89-775c25a4c7a0"}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:03:34.954724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:34.957108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:34.957768 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=39 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:03:34.962472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:34.962964 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:34.963449 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:34.964152 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:34.964612 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:34.966218 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:35.764951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e5325d0-4b3e-4558-91df-d572aecbe726 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.817243 Sep 19 12:03:35.766188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1887/3747] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 12:03:34 2022] POST /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments => generated 194 bytes in 819 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:03:43.354736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aec618f0-9e30-4566-8f89-775c25a4c7a0"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:03:43.357147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:43.365303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.365303 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.365715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.366403 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.366858 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.367308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.456688 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Invalid volume: volume aec618f0-9e30-4566-8f89-775c25a4c7a0 is already attached to instances: 99e6420b-534f-452d-ac8c-bd3ade221193 Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: POST /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments HTTP/1.1 Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 74 Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:03:43.458353 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {"volumeAttachment": {"volumeId": "aec618f0-9e30-4566-8f89-775c25a4c7a0"}} Sep 19 12:03:43.459922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Invalid volume: volume aec618f0-9e30-4566-8f89-775c25a4c7a0 is already attached to instances: 99e6420b-534f-452d-ac8c-bd3ade221193 Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'server_id': '99e6420b-534f-452d-ac8c-bd3ade221193', 'body': {'volumeAttachment': {'volumeId': 'aec618f0-9e30-4566-8f89-775c25a4c7a0'}}} Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume aec618f0-9e30-4566-8f89-775c25a4c7a0 is already attached to instances: 99e6420b-534f-452d-ac8c-bd3ade221193 Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:43.460715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume aec618f0-9e30-4566-8f89-775c25a4c7a0 is already attached to instances: 99e6420b-534f-452d-ac8c-bd3ade221193 Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:43.462091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume aec618f0-9e30-4566-8f89-775c25a4c7a0 is already attached to instances: 99e6420b-534f-452d-ac8c-bd3ade221193 Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 400 to user: Invalid volume: volume aec618f0-9e30-4566-8f89-775c25a4c7a0 is already attached to instances: 99e6420b-534f-452d-ac8c-bd3ade221193 {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1d9ba196-6efe-4554-b49b-a972e003a176 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.109305 Sep 19 12:03:43.463139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1861/3748] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 12:03:43 2022] POST /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments => generated 174 bytes in 110 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 19 12:03:43.528791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:43.528791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:43.534845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.535370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.535813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.536518 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.536974 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.537405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.621666 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lazy-loading 'services' on Instance uuid 99e6420b-534f-452d-ac8c-bd3ade221193 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:03:43.862729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8fd786c3-c6a7-40fc-aab4-d7b25965309b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments/aec618f0-9e30-4566-8f89-775c25a4c7a0" status: 202 len: 0 microversion: 2.1 time: 0.339852 Sep 19 12:03:43.863542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1888/3749] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 12:03:43 2022] DELETE /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments/aec618f0-9e30-4566-8f89-775c25a4c7a0 => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:03:43.872079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:43.874677 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:43.882519 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.883008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.883472 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.884204 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:43.884665 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:43.885091 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:43.917751 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-bbec7f2d-02aa-4e8b-b642-4712db7a0cec tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049639 Sep 19 12:03:43.918308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1862/3750] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 12:03:43 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:03:44.931194 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:44.933493 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:44.940450 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:44.940941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:44.941390 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:44.942084 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:44.942542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:44.943012 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:44.980525 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-9d47ebf8-e05a-4969-b61f-7322b13e7fd6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054203 Sep 19 12:03:44.985860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1889/3751] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 12:03:44 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:03:45.046275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:45.046822 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:45.054681 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.055292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.055802 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:45.056658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.057152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.057581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:45.084277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:03:45.315036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f9f9aa6b-65de-4476-9539-4da477903fba tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 204 len: 0 microversion: 2.1 time: 0.271876 Sep 19 12:03:45.315658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1863/3752] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:03:45 2022] DELETE /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:03:45.323986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:45.324604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:45.330519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.331004 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.331487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:45.332176 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:45.332637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:45.333082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:45.496511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:45.505082 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-576c1022-cef5-4dc2-b46b-a690a50c18be tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1683 microversion: 2.1 time: 0.184865 Sep 19 12:03:45.506085 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1890/3753] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:45 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1683 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:46.529562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:46.530265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:46.536749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:46.537244 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:46.537683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:46.538380 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:46.538840 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:46.539294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:46.678486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:46.686277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-290b741c-cb38-49e5-a272-e51727a6dba1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1683 microversion: 2.1 time: 0.161020 Sep 19 12:03:46.686842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1864/3754] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:46 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1683 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:47.715393 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:47.716011 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:47.730023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:47.730502 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:47.730940 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:47.731672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:47.732127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:47.732554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:47.802489 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:47.810638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a407a59e-09c1-4031-9fbe-9b5740b19e79 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1615 microversion: 2.1 time: 0.099109 Sep 19 12:03:47.817608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1891/3755] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:47 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1615 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:47.885888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-0093b55a-3da4-4d58-8337-e5b188131b7b req-c5177c0c-792b-45a9-b34d-9bfa6b4b45ba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e6420b-534f-452d-ac8c-bd3ade221193", "name": "network-vif-deleted", "tag": "f4375fc8-9a75-4062-8f18-a5d051eefc75"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:03:47.902720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-0093b55a-3da4-4d58-8337-e5b188131b7b req-c5177c0c-792b-45a9-b34d-9bfa6b4b45ba service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:47.903259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-0093b55a-3da4-4d58-8337-e5b188131b7b req-c5177c0c-792b-45a9-b34d-9bfa6b4b45ba service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:47.904247 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-0093b55a-3da4-4d58-8337-e5b188131b7b req-c5177c0c-792b-45a9-b34d-9bfa6b4b45ba service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:47.916935 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-0093b55a-3da4-4d58-8337-e5b188131b7b req-c5177c0c-792b-45a9-b34d-9bfa6b4b45ba service nova] Creating event network-vif-deleted:f4375fc8-9a75-4062-8f18-a5d051eefc75 for instance 99e6420b-534f-452d-ac8c-bd3ade221193 on hv-cinder-82282 Sep 19 12:03:47.921799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-0093b55a-3da4-4d58-8337-e5b188131b7b req-c5177c0c-792b-45a9-b34d-9bfa6b4b45ba service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039921 Sep 19 12:03:47.922397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1865/3756] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:03:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:03:48.846437 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:48.847359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:48.854892 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:48.855542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:48.855980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:48.856685 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:48.857138 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:48.857564 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:48.893356 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:48.894128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:48.894566 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:48.895043 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lazy-loading 'fault' on Instance uuid 99e6420b-534f-452d-ac8c-bd3ade221193 {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:03:48.939809 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:48.947828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-98ce7c58-7632-457a-bd2a-5273caaa9b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 200 len: 1332 microversion: 2.1 time: 0.107157 Sep 19 12:03:48.948405 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1892/3757] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:48 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 1332 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:49.972175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:49.972799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:49.979115 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:49.979632 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:49.980075 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:49.980809 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:49.981263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:49.981691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:49.995311 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 HTTP/1.1 Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:03:49.997026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:03:49.998464 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '99e6420b-534f-452d-ac8c-bd3ade221193'} Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:03:49.999246 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:03:50.000352 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:03:50.001900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:03:50.001900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-17deade2-1ed0-40a0-bf0f-d3915612ef63 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 404 len: 111 microversion: 2.1 time: 0.031328 Sep 19 12:03:50.001900 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1866/3758] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:49 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:03:50.008134 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-347a4b6d-5693-45e0-a9f9-75d1236bc7f9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '.version_select at 0x7f4b9a3d0160>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:50.097817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-347a4b6d-5693-45e0-a9f9-75d1236bc7f9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607079115" status: 202 len: 0 microversion: 2.1 time: 0.093552 Sep 19 12:03:50.098412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1893/3759] 10.222.0.78 () {58 vars in 1221 bytes} [Mon Sep 19 12:03:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1607079115 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:03:50.927925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ea8df9fe-886f-46cf-a679-0377b21d5ab9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: .version_select at 0x7f4b9a695f70>, body: {"keypair": {"name": "tempest-keypair-685101295", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF6yeh3ai1NiHhT6ulT6jRAY+0epvsJLnhoiIKkXWYiXQrid08SY1sHkuw292nsSa8JSa1KOnmteYnPWeD8OOvTlU06iprlYhBbPraQifplODdUpRUg/R4luPiqcwcq4Vw=="}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:03:50.943422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-ea8df9fe-886f-46cf-a679-0377b21d5ab9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:03:50.947424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-ea8df9fe-886f-46cf-a679-0377b21d5ab9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:03:51.035924 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ea8df9fe-886f-46cf-a679-0377b21d5ab9 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.112572 Sep 19 12:03:51.036590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1867/3760] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 12:03:50 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:03:53.596800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-645347660", "imageRef": "7186f9e8-3975-41b6-b2b5-93d0ee9da284", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "73bc4776-a82b-41a8-8ce8-a6075f380581"}], "security_groups": [{"name": "tempest-securitygroup--705386741"}], "key_name": "tempest-keypair-685101295", "user_data": "}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:03:53.693513 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] validate_networks() for [('73bc4776-a82b-41a8-8ce8-a6075f380581', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:03:54.077302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:03:54.077719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:03:54.078188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:03:54.078758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:03:54.079186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:03:54.088660 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:54.089128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:54.089559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:54.090270 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:54.090723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:54.091145 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:54.108268 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:03:54.115795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Getting quotas for user 7483b0e52765411d8444dfdd46549c5f and project edc640eda36b41d8b9cc59c635992d5b. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:03:54.124372 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:03:54.127368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='7186f9e8-3975-41b6-b2b5-93d0ee9da284',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:03:54.237124 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-368ed5af-58be-46f5-8fe0-71ea015ead03 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.651512 Sep 19 12:03:54.237688 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1894/3761] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 12:03:53 2022] POST /compute/v2.1/servers => generated 401 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:03:54.249576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2d831bd1-9373-4161-bad2-53c890330b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:54.250187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2d831bd1-9373-4161-bad2-53c890330b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:54.308824 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2d831bd1-9373-4161-bad2-53c890330b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:54.316188 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2d831bd1-9373-4161-bad2-53c890330b11 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1240 microversion: 2.1 time: 0.071098 Sep 19 12:03:54.317110 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1868/3762] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:54 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1240 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:55.340487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:55.341179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:55.349157 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:55.349644 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:55.354895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:55.354895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:55.354895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:55.354895 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:55.431744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:55.439323 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6610a20a-2754-4d07-9f4a-2acea3221fbf tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1236 microversion: 2.1 time: 0.103731 Sep 19 12:03:55.440302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1895/3763] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:55 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1236 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:56.469732 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:56.470458 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:56.478143 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:56.478872 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:56.479398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:56.480167 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:56.480763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:56.481249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:56.549933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:56.557593 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0ce9b47c-1bd2-4d1d-b1f5-9f2be7568892 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1310 microversion: 2.1 time: 0.092764 Sep 19 12:03:56.558154 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1869/3764] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:56 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:57.582442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:57.583049 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:57.589442 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:57.590327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:57.590327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:57.591136 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:57.591608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:57.592031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:57.727454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:57.736013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7f7df54d-2b62-484b-b76c-8cc29b54802b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1365 microversion: 2.1 time: 0.158119 Sep 19 12:03:57.736898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1896/3765] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:57 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:58.240294 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-107494e6-e543-4bbc-bc3a-357b8dc939b7 req-3a2971a8-3ca4-4115-860f-df2ce961bdc1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9321cb7b-0da5-4dfb-9107-767c34dd5fae", "tag": "551048e6-38e2-46d0-99c9-d404de19046c"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:03:58.250708 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-107494e6-e543-4bbc-bc3a-357b8dc939b7 req-3a2971a8-3ca4-4115-860f-df2ce961bdc1 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:58.251336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-107494e6-e543-4bbc-bc3a-357b8dc939b7 req-3a2971a8-3ca4-4115-860f-df2ce961bdc1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:58.252339 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-107494e6-e543-4bbc-bc3a-357b8dc939b7 req-3a2971a8-3ca4-4115-860f-df2ce961bdc1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:58.263980 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-107494e6-e543-4bbc-bc3a-357b8dc939b7 req-3a2971a8-3ca4-4115-860f-df2ce961bdc1 service nova] Creating event network-changed:551048e6-38e2-46d0-99c9-d404de19046c for instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae on hv-cinder-82282 Sep 19 12:03:58.269810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-107494e6-e543-4bbc-bc3a-357b8dc939b7 req-3a2971a8-3ca4-4115-860f-df2ce961bdc1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033670 Sep 19 12:03:58.270968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1870/3766] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:03:58.766345 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:58.767199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:58.773703 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:58.774315 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:58.774687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:58.775413 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:58.775898 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:58.776279 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:58.913404 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:03:58.921144 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-85da6fcc-32be-41a8-ab5c-1f0616c3c9b8 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1365 microversion: 2.1 time: 0.158762 Sep 19 12:03:58.921697 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1897/3767] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:58 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:03:59.946145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:03:59.946767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:03:59.953955 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:59.954418 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:59.955445 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:03:59.956155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:03:59.956615 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:03:59.957042 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:00.102594 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:00.117277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0d611fb0-a9fd-4e08-b972-8b7450693080 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1365 microversion: 2.1 time: 0.175861 Sep 19 12:04:00.119806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1871/3768] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:03:59 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1365 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:01.144704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:01.145343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:01.151894 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:01.152369 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:01.152797 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:01.153478 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:01.153926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:01.154346 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:01.283941 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:01.291919 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-12f3b664-6c51-4b7f-8ef6-9dc940e90ca6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1365 microversion: 2.1 time: 0.151346 Sep 19 12:04:01.292499 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1898/3769] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:01 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:02.164836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-5674677e-17fc-479c-84c3-cb6ac505384a req-a3023c93-52b2-49a4-b9d9-9e25f81a1792 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9321cb7b-0da5-4dfb-9107-767c34dd5fae", "name": "network-vif-plugged", "status": "completed", "tag": "551048e6-38e2-46d0-99c9-d404de19046c"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:04:02.174669 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-5674677e-17fc-479c-84c3-cb6ac505384a req-a3023c93-52b2-49a4-b9d9-9e25f81a1792 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:02.175140 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-5674677e-17fc-479c-84c3-cb6ac505384a req-a3023c93-52b2-49a4-b9d9-9e25f81a1792 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:02.175598 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-5674677e-17fc-479c-84c3-cb6ac505384a req-a3023c93-52b2-49a4-b9d9-9e25f81a1792 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:02.186641 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-5674677e-17fc-479c-84c3-cb6ac505384a req-a3023c93-52b2-49a4-b9d9-9e25f81a1792 service nova] Creating event network-vif-plugged:551048e6-38e2-46d0-99c9-d404de19046c for instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae on hv-cinder-82282 Sep 19 12:04:02.192092 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-5674677e-17fc-479c-84c3-cb6ac505384a req-a3023c93-52b2-49a4-b9d9-9e25f81a1792 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030974 Sep 19 12:04:02.192860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1872/3770] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:04:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:02.315755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:02.316368 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:02.323338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:02.323913 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:02.324354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:02.325088 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:02.325541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:02.325972 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:02.467039 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:02.475072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-25b60c33-e38f-4361-9409-00bea0147330 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1365 microversion: 2.1 time: 0.164170 Sep 19 12:04:02.475875 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1899/3771] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:02 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:03.499187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:03.499884 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:03.511933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:03.512810 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:03.513621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:03.514889 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:03.515775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:03.516917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:03.653021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:03.661191 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0063ff5c-ac59-40bb-997c-a6d203e9d19a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1365 microversion: 2.1 time: 0.166826 Sep 19 12:04:03.661750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1873/3772] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:03 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:04.683839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:04.685199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:04.687652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:04.689186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:04.696639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.696639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.696639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.696639 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.697091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.697482 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.833133 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:04.841252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-97eb8f37-e59e-4b2e-8de7-3e8c0b8a7d85 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1556 microversion: 2.1 time: 0.161247 Sep 19 12:04:04.841815 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1900/3773] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:04 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1556 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:04.872096 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:04.872570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:04.874542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:04.879882 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.880373 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.880814 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.881506 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:04.881966 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:04.882399 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:04.965860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e408652d-ba42-406f-bf85-dde64ed817c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096045 Sep 19 12:04:04.965860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1874/3774] 10.222.0.78 () {58 vars in 1275 bytes} [Mon Sep 19 12:04:04 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:06.231610 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-ffd53993-2ee0-4690-9091-3153023cf45c req-951e9a97-9d52-43f1-aedf-edd3f1caf880 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9321cb7b-0da5-4dfb-9107-767c34dd5fae", "tag": "551048e6-38e2-46d0-99c9-d404de19046c"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:04:06.238473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:06.242396 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-ffd53993-2ee0-4690-9091-3153023cf45c req-951e9a97-9d52-43f1-aedf-edd3f1caf880 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:06.242954 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-ffd53993-2ee0-4690-9091-3153023cf45c req-951e9a97-9d52-43f1-aedf-edd3f1caf880 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:06.243424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-ffd53993-2ee0-4690-9091-3153023cf45c req-951e9a97-9d52-43f1-aedf-edd3f1caf880 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:06.247504 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:06.255817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-ffd53993-2ee0-4690-9091-3153023cf45c req-951e9a97-9d52-43f1-aedf-edd3f1caf880 service nova] Creating event network-changed:551048e6-38e2-46d0-99c9-d404de19046c for instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae on hv-cinder-82282 Sep 19 12:04:06.261545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-ffd53993-2ee0-4690-9091-3153023cf45c req-951e9a97-9d52-43f1-aedf-edd3f1caf880 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033960 Sep 19 12:04:06.262158 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1901/3775] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:04:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:37.074611 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:37.075629 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:37.255271 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0dcc3444-990b-4b80-8c41-f664901f4fdc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Action: 'create', calling method: .version_select at 0x7f4b9de0f790>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-620718885", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPMxZ9xIBtXhime//nAPEsK/d2JEhVSpGG3jv3wiAwEk20S6JwmAyQfiJcuJqCFqXhSj6/EskyRs3PlN4pjcpHq9cwkP+R9aKGyMAN/QFpajazj37gp9s9xcBCBghm/FQg=="}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:04:37.272521 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-0dcc3444-990b-4b80-8c41-f664901f4fdc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:04:37.277224 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-0dcc3444-990b-4b80-8c41-f664901f4fdc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for user ab1e5eb74e784f53a9250b9a7a2220c1 and project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'key_pairs'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:04:37.360401 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0dcc3444-990b-4b80-8c41-f664901f4fdc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.287008 Sep 19 12:04:37.361019 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1875/3776] 10.222.0.78 () {60 vars in 1159 bytes} [Mon Sep 19 12:04:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:38.560624 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:38.561206 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:38.575622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:38.580112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:38.580112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:38.580112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:38.580112 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:38.580484 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:38.604544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ba16d27-933e-4d2c-bad8-710e0e58a331 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/ips" status: 200 len: 150 microversion: 2.1 time: 0.048129 Sep 19 12:04:38.605128 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1902/3777] 10.222.0.78 () {58 vars in 1248 bytes} [Mon Sep 19 12:04:38 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/ips => generated 150 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:40.314525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "679f7993-46c4-46ab-af68-6599e2362111"}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:04:40.317633 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:40.327788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:40.327788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:40.327788 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:40.328516 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:40.329208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:40.329738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:41.150713 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-76d30ce7-f8d3-4429-8763-15c4e1b4c78c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "POST /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.841487 Sep 19 12:04:41.151398 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1876/3778] 10.222.0.78 () {60 vars in 1323 bytes} [Mon Sep 19 12:04:40 2022] POST /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments => generated 194 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:48.825091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:48.825677 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:48.832331 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:48.832813 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:48.833762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:48.834444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:48.834893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:48.835347 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:48.917089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lazy-loading 'services' on Instance uuid 9321cb7b-0da5-4dfb-9107-767c34dd5fae {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:04:49.111713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-51fd49b0-fe88-44d0-8f1b-73cf7c3a9f10 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments/679f7993-46c4-46ab-af68-6599e2362111" status: 202 len: 0 microversion: 2.1 time: 0.287149 Sep 19 12:04:49.111713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1903/3779] 10.222.0.78 () {58 vars in 1416 bytes} [Mon Sep 19 12:04:48 2022] DELETE /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments/679f7993-46c4-46ab-af68-6599e2362111 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:04:49.116442 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=4 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:04:49.123080 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:49.125405 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:49.131746 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:49.132232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:49.132818 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:49.133525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:49.133951 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:49.134245 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:49.165556 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b0d9b833-418e-48b6-a85b-c647b3f6c9e6 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051594 Sep 19 12:04:49.166125 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1877/3780] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 12:04:49 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:50.181113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:50.184704 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:50.193758 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.194445 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.195234 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.196411 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.197165 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.197883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.228359 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-98c0885b-f6e1-4c17-a5b2-77a751491bff tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053645 Sep 19 12:04:50.232334 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1904/3781] 10.222.0.78 () {58 vars in 1302 bytes} [Mon Sep 19 12:04:50 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 19 12:04:50.294099 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:50.294624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:50.301157 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.301645 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.302608 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.303345 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.303805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.304233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.331622 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:04:50.569471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f0eeb5d6-893e-49ef-989c-4141652ebf9f tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 204 len: 0 microversion: 2.1 time: 0.278952 Sep 19 12:04:50.570133 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1878/3782] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:04:50 2022] DELETE /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:04:50.578378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:50.579042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:50.584999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.585487 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.586520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.587294 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:50.587755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:50.588192 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:50.722920 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:50.731350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-322d644d-88b5-4394-8aa3-c5881a8debac tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1680 microversion: 2.1 time: 0.156882 Sep 19 12:04:50.731926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1905/3783] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:50 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:51.757017 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:51.757721 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:51.764276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:51.764795 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:51.765493 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:51.766186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:51.766642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:51.767066 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:51.906184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:51.914793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-40ac7474-9783-4600-bef3-b73412e61e5b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1680 microversion: 2.1 time: 0.162652 Sep 19 12:04:51.915392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1879/3784] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:51 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1680 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:52.938285 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:52.938906 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:52.945547 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:52.946031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:52.946466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:52.947160 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:52.947638 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:52.948063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:53.014878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:53.023258 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-eab34214-8dee-42ac-a670-839147dd02c4 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1613 microversion: 2.1 time: 0.088868 Sep 19 12:04:53.023827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1906/3785] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:52 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1613 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:53.107686 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-7f6d9ef9-1fae-43e2-b328-956eac7eb516 req-9972e309-ca22-48d1-a69d-a5829efa4a82 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9321cb7b-0da5-4dfb-9107-767c34dd5fae", "name": "network-vif-deleted", "tag": "551048e6-38e2-46d0-99c9-d404de19046c"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:04:53.125893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7f6d9ef9-1fae-43e2-b328-956eac7eb516 req-9972e309-ca22-48d1-a69d-a5829efa4a82 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:53.125893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7f6d9ef9-1fae-43e2-b328-956eac7eb516 req-9972e309-ca22-48d1-a69d-a5829efa4a82 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:53.125893 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-7f6d9ef9-1fae-43e2-b328-956eac7eb516 req-9972e309-ca22-48d1-a69d-a5829efa4a82 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:53.134412 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-7f6d9ef9-1fae-43e2-b328-956eac7eb516 req-9972e309-ca22-48d1-a69d-a5829efa4a82 service nova] Creating event network-vif-deleted:551048e6-38e2-46d0-99c9-d404de19046c for instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae on hv-cinder-82282 Sep 19 12:04:53.139601 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-7f6d9ef9-1fae-43e2-b328-956eac7eb516 req-9972e309-ca22-48d1-a69d-a5829efa4a82 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036958 Sep 19 12:04:53.140646 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1880/3786] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:04:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:04:54.047444 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:54.054724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:54.054864 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:54.055301 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:54.055746 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:54.056617 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:54.057252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:54.057690 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:54.098102 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:54.098543 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:54.099552 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:54.100196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.objects.instance [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lazy-loading 'fault' on Instance uuid 9321cb7b-0da5-4dfb-9107-767c34dd5fae {{(pid=121084) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:04:54.147074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7483b0e52765411d8444dfdd46549c5f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'edc640eda36b41d8b9cc59c635992d5b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:54.155600 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6ec0162d-294c-48b8-b3d9-3201dddcaf7d tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 200 len: 1330 microversion: 2.1 time: 0.112067 Sep 19 12:04:54.156155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1907/3787] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:54 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 1330 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:55.186480 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:55.187179 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:55.193799 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:55.194276 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:55.194707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:55.195424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:55.195870 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:55.196289 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:55.209975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae HTTP/1.1 Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:04:55.214938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:55.216525 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '9321cb7b-0da5-4dfb-9107-767c34dd5fae'} Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:04:55.217360 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:55.218865 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:55.220118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:04:55.220118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-6a9306af-8908-474c-ad4f-d7a425484586 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 404 len: 111 microversion: 2.1 time: 0.031161 Sep 19 12:04:55.220118 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1881/3788] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:55 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:04:55.222174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a3f33af0-2e51-42d5-9b44-d6d079ade8c1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '.version_select at 0x7f4b9de16940>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:55.320412 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a3f33af0-2e51-42d5-9b44-d6d079ade8c1 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-685101295" status: 202 len: 0 microversion: 2.1 time: 0.102162 Sep 19 12:04:55.321031 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1908/3789] 10.222.0.78 () {58 vars in 1218 bytes} [Mon Sep 19 12:04:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-685101295 => generated 0 bytes in 104 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 19 12:04:55.727434 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1440041386", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-620718885", "security_groups": [{"name": "tempest-secgroup-smoke-1036631355"}], "block_device_mapping_v2": [{"uuid": "25974f39-b435-4dad-b835-c19a9bdbefbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2f398a5b-57ef-48ea-a71c-65894ca6738a"}]}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:04:55.892683 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] validate_networks() for [('2f398a5b-57ef-48ea-a71c-65894ca6738a', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:04:56.424523 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:04:56.425079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:04:56.425504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:04:56.425938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:04:56.426348 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:04:56.435263 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:56.435772 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:56.436205 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:56.436918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:56.437369 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:56.437789 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:56.454740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:04:56.459455 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for user ab1e5eb74e784f53a9250b9a7a2220c1 and project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:04:56.515469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:04:56.517578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25974f39-b435-4dad-b835-c19a9bdbefbd',volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:04:56.975382 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f1f44156-1caa-4c75-a7c3-b5a63a3a1770 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.251801 Sep 19 12:04:56.976040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1882/3790] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 12:04:55 2022] POST /compute/v2.1/servers => generated 406 bytes in 1253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:04:56.988563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e1c92879-bcc9-4968-a1a6-f50730cf842c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:56.990269 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e1c92879-bcc9-4968-a1a6-f50730cf842c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:57.057386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-e1c92879-bcc9-4968-a1a6-f50730cf842c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:57.065881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e1c92879-bcc9-4968-a1a6-f50730cf842c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1094 microversion: 2.1 time: 0.081828 Sep 19 12:04:57.066750 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1909/3791] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:56 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:04:57.612931 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:57.613440 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:57.619582 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.620112 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.620550 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.621235 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.621690 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.622117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.636113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae HTTP/1.1 Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:04:57.637654 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.639053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '9321cb7b-0da5-4dfb-9107-767c34dd5fae'} Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:04:57.639808 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.641347 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.643388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:04:57.643388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-dd995724-35b5-4047-bf47-ad0c8b79256a tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 404 len: 111 microversion: 2.1 time: 0.030555 Sep 19 12:04:57.643388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1883/3792] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:04:57 2022] DELETE /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:04:57.651729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:57.653415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 9321cb7b-0da5-4dfb-9107-767c34dd5fae] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:57.659986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.660486 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.660951 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.661635 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:57.662098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:57.662605 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:57.687254 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae HTTP/1.1 Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:04:57.688946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.690559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '9321cb7b-0da5-4dfb-9107-767c34dd5fae'} Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:04:57.691946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. Sep 19 12:04:57.694448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:57.695574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance 9321cb7b-0da5-4dfb-9107-767c34dd5fae could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:04:57.695574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-3eeb7675-8307-4440-a70c-b0ffb39f279b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae" status: 404 len: 111 microversion: 2.1 time: 0.047149 Sep 19 12:04:57.695574 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1910/3793] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:57 2022] GET /compute/v2.1/servers/9321cb7b-0da5-4dfb-9107-767c34dd5fae => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 19 12:04:58.104338 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-859d2c60-c759-4f59-a25b-c2c84c699264 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:58.104933 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-859d2c60-c759-4f59-a25b-c2c84c699264 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:58.185648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-859d2c60-c759-4f59-a25b-c2c84c699264 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:58.194291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-859d2c60-c759-4f59-a25b-c2c84c699264 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1094 microversion: 2.1 time: 0.093816 Sep 19 12:04:58.194844 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1884/3794] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:58 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1094 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:04:59.038786 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:59.039309 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:59.046244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.046736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.047233 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.047926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.048382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.048835 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.063573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 HTTP/1.1 Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:04:59.065210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.066608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '99e6420b-534f-452d-ac8c-bd3ade221193'} Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:04:59.067424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.068488 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.069544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:04:59.069544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-e2871e28-b8eb-4563-907e-bf2fb7ac176c tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 404 len: 111 microversion: 2.1 time: 0.032191 Sep 19 12:04:59.069544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1911/3795] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:04:59 2022] DELETE /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:04:59.075566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:59.076228 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: 99e6420b-534f-452d-ac8c-bd3ade221193] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:59.083578 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.084065 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.084504 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.085195 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.085658 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.086087 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.099803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 HTTP/1.1 Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:04:59.101424 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.102621 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '99e6420b-534f-452d-ac8c-bd3ade221193'} Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:04:59.103322 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. Sep 19 12:04:59.104452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.105667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance 99e6420b-534f-452d-ac8c-bd3ade221193 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:04:59.105667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f8e17956-10aa-4cd0-8603-a58cce8a77cd tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193" status: 404 len: 111 microversion: 2.1 time: 0.031141 Sep 19 12:04:59.105667 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1885/3796] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:59 2022] GET /compute/v2.1/servers/99e6420b-534f-452d-ac8c-bd3ade221193 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:04:59.112590 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:59.113091 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:59.119785 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.120275 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.120721 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.121419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.121874 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.122297 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.136117 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 HTTP/1.1 Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:04:59.137720 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.139002 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': 'dd02539b-f152-4db4-be5d-25c9d87db229'} Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:04:59.139725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.141501 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.142631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:04:59.142631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-faa2c94c-7c66-493c-a50e-70a392b43616 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 404 len: 111 microversion: 2.1 time: 0.030529 Sep 19 12:04:59.142631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1912/3797] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:04:59 2022] DELETE /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:04:59.148406 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:59.149021 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: dd02539b-f152-4db4-be5d-25c9d87db229] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:59.155141 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.155666 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.156100 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.157013 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.157626 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.158056 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.172374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 HTTP/1.1 Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:04:59.175249 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.177507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': 'dd02539b-f152-4db4-be5d-25c9d87db229'} Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:04:59.178281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. Sep 19 12:04:59.179881 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:04:59.181187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance dd02539b-f152-4db4-be5d-25c9d87db229 could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:04:59.181187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-96b51999-658e-4f2d-ac5a-2715d0793bdb tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229" status: 404 len: 111 microversion: 2.1 time: 0.030774 Sep 19 12:04:59.181187 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1886/3798] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:59 2022] GET /compute/v2.1/servers/dd02539b-f152-4db4-be5d-25c9d87db229 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:04:59.219156 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:04:59.219804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:04:59.226358 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.226844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.227322 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.228024 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:04:59.228485 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:04:59.229034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:04:59.295246 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:04:59.303140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8d65f0f1-46ec-48e9-8f89-288c0c4bfba9 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1192 microversion: 2.1 time: 0.088325 Sep 19 12:04:59.303749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1913/3799] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:04:59 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1192 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:00.326706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:00.327454 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:00.334109 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.334609 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.335052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.335786 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.336248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.337981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.441544 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:00.442093 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:00.451118 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.451675 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.452292 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.453155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.453611 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.454200 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.468370 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: DELETE /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd HTTP/1.1 Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:05:00.470040 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.471902 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': 'f2c0e76f-dae0-4337-bc81-8d5def6ea5bd'} Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:05:00.472725 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.474686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.476035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:05:00.476035 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8639f9e8-04f2-4961-b47c-108962e13f1b tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "DELETE /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 404 len: 111 microversion: 2.1 time: 0.033693 Sep 19 12:05:00.476185 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1914/3800] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:05:00 2022] DELETE /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:05:00.480773 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:00.481380 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] [instance: f2c0e76f-dae0-4337-bc81-8d5def6ea5bd] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:00.487606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.488097 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.488541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.489828 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:00.490287 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:00.490730 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:00.505051 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:00.508087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] HTTP exception thrown: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Request method failure captured: Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd HTTP/1.1 Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFknG6TySyMX11EXBnjqxlY3OaLXOdCHqkpEm-fepVRG9Wbg-kvU_Q53_AZOQV66VNbeoyYdAXWThmXpStI_OCh4oAlI7rWFjOCcTl8aFlkOnUkj4vgFzQWFKw14yolG9SfElPpX5xIfZ7ZIv67q1-ezuoag4j59mwrqeFNx__w5h10 Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:05:00.510076 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/edc640eda36b41d8b9cc59c635992d5b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: edc640eda36b41d8b9cc59c635992d5b Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1353629844 Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: 7483b0e52765411d8444dfdd46549c5f Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-AttachVolumeNegativeTest-1353629844-project Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.511557 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': 'f2c0e76f-dae0-4337-bc81-8d5def6ea5bd'} Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:05:00.512374 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. Sep 19 12:05:00.513631 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:05:00.515702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] Returning 404 to user: Instance f2c0e76f-dae0-4337-bc81-8d5def6ea5bd could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:05:00.515702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-a624aca2-b905-427d-bd48-4ddc8ed63359 tempest-AttachVolumeNegativeTest-1353629844 tempest-AttachVolumeNegativeTest-1353629844-project] 10.222.0.78 "GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd" status: 404 len: 111 microversion: 2.1 time: 0.035236 Sep 19 12:05:00.515702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1915/3801] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:00 2022] GET /compute/v2.1/servers/f2c0e76f-dae0-4337-bc81-8d5def6ea5bd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:05:00.522293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-7e5b5ce2-e61f-4bce-bbd1-4895b4e834d5 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1278 microversion: 2.1 time: 0.199463 Sep 19 12:05:00.525393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1887/3802] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:00 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1278 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:01.006744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-adc7d30d-bc55-4da0-94f2-afccfeef48c0 req-f0d0f903-5ab4-410a-804a-c97672c94961 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe", "tag": "5c7510ad-0231-482d-a1be-40b017b3ec70"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:05:01.022257 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-adc7d30d-bc55-4da0-94f2-afccfeef48c0 req-f0d0f903-5ab4-410a-804a-c97672c94961 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:01.022799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-adc7d30d-bc55-4da0-94f2-afccfeef48c0 req-f0d0f903-5ab4-410a-804a-c97672c94961 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:01.023261 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-adc7d30d-bc55-4da0-94f2-afccfeef48c0 req-f0d0f903-5ab4-410a-804a-c97672c94961 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:01.035818 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-adc7d30d-bc55-4da0-94f2-afccfeef48c0 req-f0d0f903-5ab4-410a-804a-c97672c94961 service nova] Creating event network-changed:5c7510ad-0231-482d-a1be-40b017b3ec70 for instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe on hv-cinder-82282 Sep 19 12:05:01.041869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-adc7d30d-bc55-4da0-94f2-afccfeef48c0 req-f0d0f903-5ab4-410a-804a-c97672c94961 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039109 Sep 19 12:05:01.042774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1916/3803] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:05:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:05:01.549962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:01.551050 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:01.558027 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:01.559651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:01.559651 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:01.559847 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:01.560366 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:01.560800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:01.781800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:01.797069 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ff0fcdfb-b54f-49e2-a3eb-ae94c3004347 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.250756 Sep 19 12:05:01.797673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1888/3804] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:01 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:02.824155 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:02.824968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:02.831427 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:02.832260 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:02.833384 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:02.834191 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:02.834850 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:02.835480 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:03.051196 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:03.059587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-cd45b1d2-7863-44b6-8daf-eeb1f446feb8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.240276 Sep 19 12:05:03.060111 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1917/3805] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:02 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:05:04.083676 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:04.084308 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:04.091960 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:04.092712 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:04.093358 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:04.094083 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:04.094542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:04.094976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:04.266961 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:04.275548 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-97aed971-e0c3-4cba-9d94-35aa7e641fa8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.196515 Sep 19 12:05:04.276177 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1889/3806] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:04 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:05.297988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:05.298693 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:05.305800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:05.309406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:05.309406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:05.309406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:05.309406 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:05.309739 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:05.442844 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:05.450595 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7ee5c843-4306-478a-9cf7-2bd21e0d47fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.156488 Sep 19 12:05:05.451195 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1918/3807] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:05 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:06.473407 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:06.474022 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:06.476456 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:06.481763 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:06.483920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:06.483920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:06.483920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:06.483920 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:06.484397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:06.618417 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:06.626295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-a66bb794-1315-4fe9-99e4-e87027a39233 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.156872 Sep 19 12:05:06.626860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1890/3808] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:06 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:07.650350 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:07.650985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:07.653386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:07.668573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:07.668573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:07.668573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:07.668573 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:07.668931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:07.668931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:07.804137 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:07.811877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-32f28995-8554-4835-96d0-7e7330ddbaca tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.165858 Sep 19 12:05:07.814318 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1919/3809] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:07 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:08.835892 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:08.836507 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:08.838833 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=8 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:08.839528 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:08.844782 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:08.845291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:08.845730 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:08.846487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:08.846946 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:08.847437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:08.993743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:09.001509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-c5d0a237-21b5-4bba-b9f7-504ebd17ab0d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.170212 Sep 19 12:05:09.002293 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1891/3810] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:08 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:10.025882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:10.026522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:10.033027 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:10.033497 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:10.033945 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:10.034650 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:10.035300 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:10.035568 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:10.168265 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:10.176351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b85076e8-c8d1-4c71-9901-7d9d9d7864ec tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.154310 Sep 19 12:05:10.176931 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1920/3811] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:10 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:10.559265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-8102cd2f-ccbb-4ae8-b7cf-0e81e751a4a1 req-b2bd2d5e-9312-4bc9-9537-69679c68d5b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe", "name": "network-vif-plugged", "status": "completed", "tag": "5c7510ad-0231-482d-a1be-40b017b3ec70"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:05:10.570093 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8102cd2f-ccbb-4ae8-b7cf-0e81e751a4a1 req-b2bd2d5e-9312-4bc9-9537-69679c68d5b5 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:10.570562 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8102cd2f-ccbb-4ae8-b7cf-0e81e751a4a1 req-b2bd2d5e-9312-4bc9-9537-69679c68d5b5 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:10.571127 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-8102cd2f-ccbb-4ae8-b7cf-0e81e751a4a1 req-b2bd2d5e-9312-4bc9-9537-69679c68d5b5 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:10.574856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:05:10.581969 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-8102cd2f-ccbb-4ae8-b7cf-0e81e751a4a1 req-b2bd2d5e-9312-4bc9-9537-69679c68d5b5 service nova] Creating event network-vif-plugged:5c7510ad-0231-482d-a1be-40b017b3ec70 for instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe on hv-cinder-82282 Sep 19 12:05:10.587937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-8102cd2f-ccbb-4ae8-b7cf-0e81e751a4a1 req-b2bd2d5e-9312-4bc9-9537-69679c68d5b5 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032391 Sep 19 12:05:10.588530 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1892/3812] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:05:11.199468 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:11.200008 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:11.206747 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:11.207343 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:11.207766 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:11.208483 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:11.208946 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:11.209386 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:11.398985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:11.406879 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8c0ce439-3c4b-4b55-9fa9-83d365e6b16c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1266 microversion: 2.1 time: 0.211368 Sep 19 12:05:11.407492 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1921/3813] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:11 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:12.433841 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:12.434590 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:12.442591 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:12.443082 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:12.443551 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:12.444762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:12.445252 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:12.445648 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:12.602908 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:12.611745 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-61d77679-a6f4-486b-b932-42f039b1f418 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1453 microversion: 2.1 time: 0.182005 Sep 19 12:05:12.612325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1893/3814] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:12 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1453 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:12.637068 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:05:12.637687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:05:12.644646 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:12.645142 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:12.645583 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:12.646284 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:12.647336 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:12.647960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:12.780579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:05:12.788999 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1edfbf2e-e5ec-4f93-9a32-5e0f7172c88b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1453 microversion: 2.1 time: 0.156001 Sep 19 12:05:12.789587 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1922/3815] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:05:12 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:05:15.556849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-e4f40fb1-170b-4bbf-bebe-ea5d3d2e8c88 req-dd9dd154-8cf1-4376-95e1-3942d589ab92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe", "tag": "5c7510ad-0231-482d-a1be-40b017b3ec70"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:05:15.566675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-e4f40fb1-170b-4bbf-bebe-ea5d3d2e8c88 req-dd9dd154-8cf1-4376-95e1-3942d589ab92 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:05:15.567160 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-e4f40fb1-170b-4bbf-bebe-ea5d3d2e8c88 req-dd9dd154-8cf1-4376-95e1-3942d589ab92 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:05:15.567618 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-e4f40fb1-170b-4bbf-bebe-ea5d3d2e8c88 req-dd9dd154-8cf1-4376-95e1-3942d589ab92 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:05:15.579473 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-e4f40fb1-170b-4bbf-bebe-ea5d3d2e8c88 req-dd9dd154-8cf1-4376-95e1-3942d589ab92 service nova] Creating event network-changed:5c7510ad-0231-482d-a1be-40b017b3ec70 for instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe on hv-cinder-82282 Sep 19 12:05:15.585230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-e4f40fb1-170b-4bbf-bebe-ea5d3d2e8c88 req-dd9dd154-8cf1-4376-95e1-3942d589ab92 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031427 Sep 19 12:05:15.585838 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1894/3816] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:05:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:13.474608 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5a61e391-cf5e-4b5b-8e83-9b022a7b5946] AMQP server on 10.222.0.78:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 19 12:07:13.475159 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:13.476070 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:13.476723 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:07:13.476866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 12:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe (ip 10.222.0.78) !!! Sep 19 12:07:13.478774 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:07:13.478900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 12:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe (ip 10.222.0.78) !!! Sep 19 12:07:13.480528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:07:13.480651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 12:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe (ip 10.222.0.78) !!! Sep 19 12:07:13.487778 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:13.492805 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:13.500924 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.501441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.501883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.502647 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.503110 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.503565 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.529549 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Going to try to terminate instance {{(pid=121084) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:07:13.809620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f8f41512-4e8c-419c-af16-50dd2f307ef3 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 204 len: 0 microversion: 2.1 time: 0.336836 Sep 19 12:07:13.810366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1923/3817] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:07:13 2022] DELETE /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:07:13.817299 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR oslo.messaging._drivers.impl_rabbit [-] [7c5ebcaf-5fcc-467e-864b-bd7760c36cbf] AMQP server on 10.222.0.78:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 19 12:07:13.819402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=7 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:13.819402 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=9 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:13.819624 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:07:13.819750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 12:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe (ip 10.222.0.78) !!! Sep 19 12:07:13.822004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 19 12:07:13.822117 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 12:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe (ip 10.222.0.78) !!! Sep 19 12:07:13.828740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:13.829432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:13.838767 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.839290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.839733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:13.840479 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:13.840932 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:13.841356 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:14.108715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:14.116803 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-49d2b71e-52ab-4de1-ad1c-ce8eaf9e9c7e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1578 microversion: 2.1 time: 0.301371 Sep 19 12:07:14.117385 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1895/3818] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:13 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1578 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:15.140851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:15.141588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:15.149204 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.149686 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.150127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.150820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:15.151302 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:15.151731 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:15.170679 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] [5a61e391-cf5e-4b5b-8e83-9b022a7b5946] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46942. Sep 19 12:07:15.336729 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:15.345244 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-41f1ebce-191f-4e03-a3bc-8de99aea7b76 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1578 microversion: 2.1 time: 0.208622 Sep 19 12:07:15.345812 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1924/3819] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:15 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1578 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:16.305411 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] [7c5ebcaf-5fcc-467e-864b-bd7760c36cbf] Reconnected to AMQP server on 10.222.0.78:5672 via [amqp] client with port 46950. Sep 19 12:07:16.358095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-ec271a0e-30a0-45c1-8345-16ac437497ff req-968fbe8b-4305-45f8-91fb-0594140877e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe", "name": "network-vif-deleted", "tag": "5c7510ad-0231-482d-a1be-40b017b3ec70"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:07:16.369393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ec271a0e-30a0-45c1-8345-16ac437497ff req-968fbe8b-4305-45f8-91fb-0594140877e4 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.370208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ec271a0e-30a0-45c1-8345-16ac437497ff req-968fbe8b-4305-45f8-91fb-0594140877e4 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.370846 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-ec271a0e-30a0-45c1-8345-16ac437497ff req-968fbe8b-4305-45f8-91fb-0594140877e4 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.378878 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:16.379526 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:16.386952 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.388470 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.388769 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-ec271a0e-30a0-45c1-8345-16ac437497ff req-968fbe8b-4305-45f8-91fb-0594140877e4 service nova] Creating event network-vif-deleted:5c7510ad-0231-482d-a1be-40b017b3ec70 for instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe on hv-cinder-82282 Sep 19 12:07:16.389391 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.390332 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:16.391023 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:16.391672 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:16.394387 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-ec271a0e-30a0-45c1-8345-16ac437497ff req-968fbe8b-4305-45f8-91fb-0594140877e4 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102800 Sep 19 12:07:16.395462 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1896/3820] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:16.494104 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:16.503738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2195f4a2-3a58-44d9-8b4a-9c50007b6243 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1510 microversion: 2.1 time: 0.138379 Sep 19 12:07:16.505927 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1925/3821] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:16 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1510 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:17.528807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:17.529514 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:17.538430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.538430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.538430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.538430 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.538800 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.539145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.571974 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:17.572500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:17.572940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:17.573394 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.objects.instance [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lazy-loading 'fault' on Instance uuid 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe {{(pid=121085) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 19 12:07:17.866336 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:17.873831 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-4727d263-8502-4089-b43f-33478e969d57 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 200 len: 1184 microversion: 2.1 time: 0.349275 Sep 19 12:07:17.874404 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1897/3822] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:17 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 1184 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:18.897637 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:18.898237 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:18.904724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.905210 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.905652 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.906341 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:18.906800 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:18.907264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:18.920949 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] HTTP exception thrown: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Request method failure captured: Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe HTTP/1.1 Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFrOoaHCEs90XlrSpKoGu3_AIaiVGf83BGmlocJ_gEZwDpGkk7glPwIecYMIu1ETXKlkO9uiJTIEER_CFoVu2BVDb46EwZ_QrEayCobfMWm_5Yo6qkR9oaK2dPyXykuYjNgDgOjxUQSYJhj5anLoJztTBJoJulzXo-Oa1U248Xdh4mc Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:07:18.922593 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestVolumeBootPattern-574546185 Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: ab1e5eb74e784f53a9250b9a7a2220c1 Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:07:18.924755 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe'} Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:07:18.925603 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:07:18.927072 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:07:18.928354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Returning 404 to user: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:07:18.928354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-db25b831-0409-4ad2-9b98-ed390fe6e90a tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 404 len: 111 microversion: 2.1 time: 0.030881 Sep 19 12:07:18.928354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1926/3823] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:18 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:07:19.019990 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-884818146", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-620718885", "security_groups": [{"name": "tempest-secgroup-smoke-1036631355"}], "block_device_mapping_v2": [{"uuid": "25974f39-b435-4dad-b835-c19a9bdbefbd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2f398a5b-57ef-48ea-a71c-65894ca6738a"}]}} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:07:19.133962 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.network.neutron [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] validate_networks() for [('2f398a5b-57ef-48ea-a71c-65894ca6738a', None, None, None, None, None)] {{(pid=121085) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:07:19.513497 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Flavor limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:07:19.514060 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Image limits 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:07:19.514675 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Flavor pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:07:19.515320 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Image pref 0:0:0 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:07:19.515793 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.virt.hardware [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121085) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:07:19.525437 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.530198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.530198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.530198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:19.530198 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:19.530585 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:19.544270 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:07:19.548184 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.quota [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for user ab1e5eb74e784f53a9250b9a7a2220c1 and project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'cores', 'instances', 'ram'} {{(pid=121085) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:07:19.610561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Going to run 1 instances... {{(pid=121085) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:07:19.610561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='25974f39-b435-4dad-b835-c19a9bdbefbd',volume_size=None,volume_type=None)] {{(pid=121085) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:07:19.996077 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-99edbb90-0152-4234-a48c-12d395c88ac1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.980429 Sep 19 12:07:19.996727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1898/3824] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 12:07:19 2022] POST /compute/v2.1/servers => generated 406 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:07:20.008623 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-b7a1c330-b228-483b-80d4-e46215bc541b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:20.009239 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-b7a1c330-b228-483b-80d4-e46215bc541b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:20.062491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-b7a1c330-b228-483b-80d4-e46215bc541b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:20.069983 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-b7a1c330-b228-483b-80d4-e46215bc541b tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1093 microversion: 2.1 time: 0.065343 Sep 19 12:07:20.070853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1927/3825] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:20 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:21.093558 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:21.094290 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:21.100355 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:21.100842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:21.101280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:21.101968 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:21.102422 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:21.102850 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:21.170576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:21.178807 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1257da61-0a95-42b5-a412-338228225b95 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1143 microversion: 2.1 time: 0.089571 Sep 19 12:07:21.179408 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1899/3826] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:21 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:22.202066 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:22.202713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:22.211149 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.211579 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.212019 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.212719 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:22.213179 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:22.213607 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:22.276342 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:22.284948 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-327487ea-225d-402a-89f6-44bb150df453 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1199 microversion: 2.1 time: 0.086839 Sep 19 12:07:22.285528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1928/3827] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:22 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:23.312513 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:23.313116 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:23.320186 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.320696 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.321233 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.321944 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:23.322400 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:23.322827 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:23.488081 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:23.495995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e51717e8-2b8d-4370-9b05-2aa71251e7aa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1277 microversion: 2.1 time: 0.187376 Sep 19 12:07:23.496570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1900/3828] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:23 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1277 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:24.325213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-a0a5f8f3-187f-4ceb-b5cf-b574514dbe87 req-9586dc36-aa5d-4f41-9661-e8b32ecd4033 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ddb9ed2-884b-4620-96ec-0b5a2ceca826", "tag": "bb94d8cf-b3d8-498a-98d2-cf530ab74f38"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:07:24.335465 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-a0a5f8f3-187f-4ceb-b5cf-b574514dbe87 req-9586dc36-aa5d-4f41-9661-e8b32ecd4033 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.335978 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-a0a5f8f3-187f-4ceb-b5cf-b574514dbe87 req-9586dc36-aa5d-4f41-9661-e8b32ecd4033 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.336407 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-a0a5f8f3-187f-4ceb-b5cf-b574514dbe87 req-9586dc36-aa5d-4f41-9661-e8b32ecd4033 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.347673 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-a0a5f8f3-187f-4ceb-b5cf-b574514dbe87 req-9586dc36-aa5d-4f41-9661-e8b32ecd4033 service nova] Creating event network-changed:bb94d8cf-b3d8-498a-98d2-cf530ab74f38 for instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 on hv-cinder-82282 Sep 19 12:07:24.352627 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-a0a5f8f3-187f-4ceb-b5cf-b574514dbe87 req-9586dc36-aa5d-4f41-9661-e8b32ecd4033 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031900 Sep 19 12:07:24.353228 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1929/3829] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:24.519866 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:24.520471 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:24.527805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.528313 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.528750 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.529487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:24.529975 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:24.530396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:24.666856 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:24.675586 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-726a6f11-d6ab-46ba-89af-9b5a5904e340 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.159493 Sep 19 12:07:24.677762 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1901/3830] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:24 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:25.699613 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:25.700339 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:25.707256 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.707742 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.708180 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.708882 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:25.709335 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:25.709762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:25.838125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:25.845872 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-625ee8b2-5d9a-4a3f-921f-47091c12bda4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.151027 Sep 19 12:07:25.846441 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1930/3831] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:25 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:26.868419 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:26.869014 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:26.882891 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.883420 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.883901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:26.884579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:26.885040 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:26.885738 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:27.024371 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:27.032351 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-3ab78d15-7deb-4ef1-9767-0837ce1dc6ef tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.167871 Sep 19 12:07:27.032928 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1902/3832] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:26 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:28.056349 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:28.056960 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:28.063423 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.063911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.064378 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.065668 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:28.066126 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:28.066556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:28.197827 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:28.205642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4b02d51f-916d-40da-9010-cd35e9160758 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.153161 Sep 19 12:07:28.206208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1931/3833] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:28 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:29.228668 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:29.229278 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:29.235784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.236265 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.236706 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.237393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:29.237851 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:29.238281 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:29.367542 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:29.375238 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e5f954de-5dd5-4d55-8360-7463c39fe203 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.150456 Sep 19 12:07:29.375835 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1903/3834] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:29 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:07:30.399976 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:30.400507 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:30.402900 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:30.407711 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.408199 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.409338 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.410140 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:30.410599 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:30.411028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:30.548032 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:30.555717 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ab37fd4e-ad01-47b2-9064-c037cb824fcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.159806 Sep 19 12:07:30.556282 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1932/3835] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:30 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:31.578579 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:31.579217 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:31.581215 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:31.582241 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=6 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:07:31.588031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.588634 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.589229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.590145 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:31.590605 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:31.591259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:31.725208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:31.733036 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-0a2808e8-5c12-4255-8af1-a52c0246cdbc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.158337 Sep 19 12:07:31.739509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1904/3836] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:31 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:32.757242 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:32.757936 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:32.764632 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.765115 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.765554 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.766245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:32.766705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:32.767139 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:32.902419 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:32.910475 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ed439bbf-5f5e-4b0d-8dbf-94a9d1d7e755 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.157760 Sep 19 12:07:32.911063 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1933/3837] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:32 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:33.320707 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-3ba752fd-001c-4334-b1f9-b0d57dacf43c req-f31cae08-255d-4aa3-9c39-bc0662e2d88d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddb9ed2-884b-4620-96ec-0b5a2ceca826", "name": "network-vif-plugged", "status": "completed", "tag": "bb94d8cf-b3d8-498a-98d2-cf530ab74f38"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:07:33.329965 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3ba752fd-001c-4334-b1f9-b0d57dacf43c req-f31cae08-255d-4aa3-9c39-bc0662e2d88d service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.330438 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3ba752fd-001c-4334-b1f9-b0d57dacf43c req-f31cae08-255d-4aa3-9c39-bc0662e2d88d service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.330867 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-3ba752fd-001c-4334-b1f9-b0d57dacf43c req-f31cae08-255d-4aa3-9c39-bc0662e2d88d service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.342111 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-3ba752fd-001c-4334-b1f9-b0d57dacf43c req-f31cae08-255d-4aa3-9c39-bc0662e2d88d service nova] Creating event network-vif-plugged:bb94d8cf-b3d8-498a-98d2-cf530ab74f38 for instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 on hv-cinder-82282 Sep 19 12:07:33.347071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-3ba752fd-001c-4334-b1f9-b0d57dacf43c req-f31cae08-255d-4aa3-9c39-bc0662e2d88d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084931 Sep 19 12:07:33.347715 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1905/3838] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:07:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:07:33.933388 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:33.933911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:33.940364 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.940851 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.941289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:33.941975 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:33.942429 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:33.942858 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:34.074098 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:34.083642 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2fe84c6d-3de1-45e3-bbbe-59b2f7e7eb62 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1265 microversion: 2.1 time: 0.154170 Sep 19 12:07:34.084214 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1934/3839] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:33 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:35.108008 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:35.108719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:35.116433 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.117393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.117393 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.118053 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.118512 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.118941 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.254849 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:35.262997 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f215437e-eb69-45e6-9df5-0ca21f26180f tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1452 microversion: 2.1 time: 0.159905 Sep 19 12:07:35.265103 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1906/3840] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:35 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:35.286042 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:07:35.286653 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:07:35.293252 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.293735 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.294174 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.294862 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:35.295389 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:35.295823 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:35.427620 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:07:35.435643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-409ba5c4-6941-451f-81d8-9a1cf2aebb2d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1452 microversion: 2.1 time: 0.153954 Sep 19 12:07:35.436222 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1935/3841] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:07:35 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:07:37.405794 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-aadae2ba-7b6b-4304-9460-3ef733da254d req-cebe8753-fa11-4977-87c9-c1ba555ed788 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ddb9ed2-884b-4620-96ec-0b5a2ceca826", "tag": "bb94d8cf-b3d8-498a-98d2-cf530ab74f38"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:07:37.416015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-aadae2ba-7b6b-4304-9460-3ef733da254d req-cebe8753-fa11-4977-87c9-c1ba555ed788 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:07:37.416487 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-aadae2ba-7b6b-4304-9460-3ef733da254d req-cebe8753-fa11-4977-87c9-c1ba555ed788 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:07:37.416916 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-aadae2ba-7b6b-4304-9460-3ef733da254d req-cebe8753-fa11-4977-87c9-c1ba555ed788 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:07:37.428392 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-aadae2ba-7b6b-4304-9460-3ef733da254d req-cebe8753-fa11-4977-87c9-c1ba555ed788 service nova] Creating event network-changed:bb94d8cf-b3d8-498a-98d2-cf530ab74f38 for instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 on hv-cinder-82282 Sep 19 12:07:37.433079 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-aadae2ba-7b6b-4304-9460-3ef733da254d req-cebe8753-fa11-4977-87c9-c1ba555ed788 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088583 Sep 19 12:07:37.433768 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1907/3842] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:09:13.056379 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:13.057172 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:13.061866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1521525588", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-620718885", "security_groups": [{"name": "tempest-secgroup-smoke-1036631355"}], "block_device_mapping_v2": [{"uuid": "f0cf4703-6804-4d5d-992c-3ae6e6b121ef", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "2f398a5b-57ef-48ea-a71c-65894ca6738a"}]}} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:09:13.177622 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.network.neutron [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] validate_networks() for [('2f398a5b-57ef-48ea-a71c-65894ca6738a', None, None, None, None, None)] {{(pid=121084) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 19 12:09:13.610886 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Flavor limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 19 12:09:13.611366 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Image limits 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 19 12:09:13.611837 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Flavor pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 19 12:09:13.612245 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Image pref 0:0:0 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 19 12:09:13.612654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.virt.hardware [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121084) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 19 12:09:13.621351 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.621950 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.622264 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.622985 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:13.623466 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:13.624382 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:13.641860 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 19 12:09:13.645840 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.quota [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Getting quotas for user ab1e5eb74e784f53a9250b9a7a2220c1 and project b7d811c8ed584ddb92b4642d85e8db00. Resources: {'cores', 'instances', 'ram'} {{(pid=121084) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 19 12:09:13.701054 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Going to run 1 instances... {{(pid=121084) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 19 12:09:13.703891 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f0cf4703-6804-4d5d-992c-3ae6e6b121ef',volume_size=None,volume_type=None)] {{(pid=121084) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 19 12:09:14.129820 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-ab0d485c-636e-4b22-b95b-5259ff13c08c tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.075022 Sep 19 12:09:14.137248 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1936/3843] 10.222.0.78 () {60 vars in 1147 bytes} [Mon Sep 19 12:09:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 1076 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 19 12:09:14.142509 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:14.143499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=64 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:14.151459 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-1686ee0b-9d7f-4237-af6c-0151398031db tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:14.152175 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-1686ee0b-9d7f-4237-af6c-0151398031db tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:14.208926 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-1686ee0b-9d7f-4237-af6c-0151398031db tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:14.221901 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-1686ee0b-9d7f-4237-af6c-0151398031db tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1094 microversion: 2.1 time: 0.082187 Sep 19 12:09:14.226561 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1908/3844] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:14 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:15.248163 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:15.248804 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:15.255857 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.256340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.256777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.257702 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:15.258154 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:15.258577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:15.322934 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:15.330795 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-6e8fccce-08bb-46ac-a519-38e19d017042 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1144 microversion: 2.1 time: 0.086623 Sep 19 12:09:15.331409 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1937/3845] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:15 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:16.355243 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:16.355937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:16.362854 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.363396 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.363839 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.364691 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:16.365139 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:16.365570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:16.435208 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:16.445189 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-2e0f8539-6724-4ce1-acce-8ef9917a8944 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1210 microversion: 2.1 time: 0.095368 Sep 19 12:09:16.445781 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1909/3846] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:16 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1210 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:17.469074 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:17.470367 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:17.477588 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:17.478103 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:17.478555 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:17.479313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:17.479780 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:17.480208 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:17.618186 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:17.626226 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-f5dbeead-44a8-4c49-a6b2-1763028857cd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1278 microversion: 2.1 time: 0.161017 Sep 19 12:09:17.626807 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1938/3847] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:17 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:17.916486 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [req-c8026e6d-8f30-4445-9484-13ba7f63e114 req-9703cbf3-e60a-4b18-a454-177b9f2f75f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891e6f35-aa05-434e-b112-67d10c65b655", "tag": "0acec94e-33b2-4493-8549-573a5c2a2791"}]} {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:09:17.926863 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c8026e6d-8f30-4445-9484-13ba7f63e114 req-9703cbf3-e60a-4b18-a454-177b9f2f75f7 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:17.927958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c8026e6d-8f30-4445-9484-13ba7f63e114 req-9703cbf3-e60a-4b18-a454-177b9f2f75f7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:17.927958 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [req-c8026e6d-8f30-4445-9484-13ba7f63e114 req-9703cbf3-e60a-4b18-a454-177b9f2f75f7 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:17.939922 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.compute.server_external_events [req-c8026e6d-8f30-4445-9484-13ba7f63e114 req-9703cbf3-e60a-4b18-a454-177b9f2f75f7 service nova] Creating event network-changed:0acec94e-33b2-4493-8549-573a5c2a2791 for instance 891e6f35-aa05-434e-b112-67d10c65b655 on hv-cinder-82282 Sep 19 12:09:17.945068 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [req-c8026e6d-8f30-4445-9484-13ba7f63e114 req-9703cbf3-e60a-4b18-a454-177b9f2f75f7 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Sep 19 12:09:17.945736 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1910/3848] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:09:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:18.649937 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:18.650545 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:18.657845 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:18.659839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:18.659839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:18.659839 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:18.660125 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:18.660394 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:18.795884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:18.804563 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-1ecdbebe-2594-48b1-8b53-22fbb9cb1458 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.158580 Sep 19 12:09:18.805143 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1939/3849] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:18 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:19.828439 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:19.829137 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:19.835282 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.835774 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.836218 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.836913 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:19.837543 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:19.837976 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:19.967071 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:19.974981 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-72a80726-7f80-4508-9253-48c9622582e8 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.151190 Sep 19 12:09:19.975581 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1911/3850] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:19 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:20.997967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:20.998619 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:21.005713 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.006201 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.006643 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.007629 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:21.008089 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:21.008520 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:21.138893 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:21.147392 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-fe505d4c-f1f0-42d8-b58a-3159ec3ad880 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.153342 Sep 19 12:09:21.147967 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1940/3851] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:20 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:22.170583 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:22.171258 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:22.178536 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.179026 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.179544 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.180237 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:22.180701 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:22.181134 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:22.315505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:22.323248 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-e39d99f6-8378-45c9-9ccd-cccdf30893e6 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.157003 Sep 19 12:09:22.327999 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1912/3852] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:22 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:23.346533 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:23.347064 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:23.353537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.354020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.354448 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:23.355127 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:23.355604 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:23.356028 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:23.486527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:23.494100 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-621535af-4d6e-42e3-b3c9-6811146de530 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.152037 Sep 19 12:09:23.494657 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1941/3853] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:23 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:24.517300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:24.517937 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:24.520410 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell0:SELECT=2 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:24.525301 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:24.529452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:24.529452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:24.529452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:24.529452 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:24.529989 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:24.664775 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:24.677567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-525f9da3-4793-430e-9308-c6cfc98f1bfa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.159258 Sep 19 12:09:24.677567 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1913/3854] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:24 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:25.696618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:25.697230 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:25.699046 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=2 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:25.699744 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell0:SELECT=6 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:09:25.705184 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.705669 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.706113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.706802 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:25.707291 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:25.707724 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:25.840473 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:25.848762 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-55fdd545-74af-485d-aa44-a41559325cae tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.156063 Sep 19 12:09:25.849327 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1942/3855] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:25 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:26.872214 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:26.872823 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:26.879816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.880300 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.880740 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:26.881432 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:26.882152 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:26.882576 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:27.043573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:27.043573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-ce9effe9-4627-4b29-a5cf-42d68dac2b06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.169798 Sep 19 12:09:27.043573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1914/3856] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:26 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:28.060415 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:28.061207 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:28.067707 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.068289 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.068738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.069446 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:28.069909 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:28.070417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:28.204161 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:28.212705 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-4ce00e0a-c14a-4bab-9632-114ac97c1397 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.156385 Sep 19 12:09:28.213277 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1943/3857] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:28 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:29.235325 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:29.235938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:29.243034 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.243555 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.243995 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.244682 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.245138 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.245570 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.376052 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:29.383938 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-f27516f1-9db0-4e70-bb5d-146b08ea1cc4 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.152528 Sep 19 12:09:29.384499 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1915/3858] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:29 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:29.813240 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-4b4c92e5-4e1c-4e0d-a90a-a3974192d212 req-d84d2a79-71d6-48be-88df-1563aa39ef9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891e6f35-aa05-434e-b112-67d10c65b655", "name": "network-vif-plugged", "status": "completed", "tag": "0acec94e-33b2-4493-8549-573a5c2a2791"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:09:29.823824 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-4b4c92e5-4e1c-4e0d-a90a-a3974192d212 req-d84d2a79-71d6-48be-88df-1563aa39ef9d service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:29.824307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-4b4c92e5-4e1c-4e0d-a90a-a3974192d212 req-d84d2a79-71d6-48be-88df-1563aa39ef9d service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:29.824738 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-4b4c92e5-4e1c-4e0d-a90a-a3974192d212 req-d84d2a79-71d6-48be-88df-1563aa39ef9d service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:29.836014 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-4b4c92e5-4e1c-4e0d-a90a-a3974192d212 req-d84d2a79-71d6-48be-88df-1563aa39ef9d service nova] Creating event network-vif-plugged:0acec94e-33b2-4493-8549-573a5c2a2791 for instance 891e6f35-aa05-434e-b112-67d10c65b655 on hv-cinder-82282 Sep 19 12:09:29.841213 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-4b4c92e5-4e1c-4e0d-a90a-a3974192d212 req-d84d2a79-71d6-48be-88df-1563aa39ef9d service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031681 Sep 19 12:09:29.841791 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1944/3859] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:09:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:09:30.406704 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:30.407277 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:30.413836 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:30.414323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:30.414764 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:30.415500 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:30.415957 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:30.416388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:30.547292 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:30.555727 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-9a478f76-063d-4c98-a209-c1ca82aa9a39 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1266 microversion: 2.1 time: 0.152981 Sep 19 12:09:30.556296 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1916/3860] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:30 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:31.578968 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:31.579740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:31.586003 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:31.586491 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:31.586926 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:31.587651 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:31.588113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:31.588541 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:31.723929 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:31.731866 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-78f93092-ea6d-4b48-897e-6cad200bdbfd tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1453 microversion: 2.1 time: 0.157704 Sep 19 12:09:31.732439 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1945/3861] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:31 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1453 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:31.754993 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:09:31.755642 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:09:31.762469 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:31.768680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:31.768680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:31.768680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:31.768680 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:31.769067 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:31.897940 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:09:31.905635 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-15f257a6-b7a1-4a50-9fc6-b2ef1bc76dcc tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1453 microversion: 2.1 time: 0.155023 Sep 19 12:09:31.906196 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1917/3862] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:09:31 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1453 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:09:33.993777 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-4ebb8f84-b687-401c-8b0a-efb77ceb317c req-81f9526f-f609-4325-a2b3-782c9f073cb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891e6f35-aa05-434e-b112-67d10c65b655", "tag": "0acec94e-33b2-4493-8549-573a5c2a2791"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:09:34.004007 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-4ebb8f84-b687-401c-8b0a-efb77ceb317c req-81f9526f-f609-4325-a2b3-782c9f073cb1 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:09:34.004869 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-4ebb8f84-b687-401c-8b0a-efb77ceb317c req-81f9526f-f609-4325-a2b3-782c9f073cb1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:09:34.005305 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-4ebb8f84-b687-401c-8b0a-efb77ceb317c req-81f9526f-f609-4325-a2b3-782c9f073cb1 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:09:34.016714 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-4ebb8f84-b687-401c-8b0a-efb77ceb317c req-81f9526f-f609-4325-a2b3-782c9f073cb1 service nova] Creating event network-changed:0acec94e-33b2-4493-8549-573a5c2a2791 for instance 891e6f35-aa05-434e-b112-67d10c65b655 on hv-cinder-82282 Sep 19 12:09:34.022618 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-4ebb8f84-b687-401c-8b0a-efb77ceb317c req-81f9526f-f609-4325-a2b3-782c9f073cb1 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032962 Sep 19 12:09:34.023576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1946/3863] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:02.178004 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_api:SELECT=22 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:02.179532 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG dbcounter [-] [121085] Writing DB stats nova_cell1:SELECT=50 {{(pid=121085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:02.180556 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:02.180996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:11:02.180996 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 12:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 (ip 10.222.0.78) !!! Sep 19 12:11:02.181304 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG dbcounter [-] [121084] Writing DB stats nova_cell1:SELECT=54 {{(pid=121084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 19 12:11:02.182168 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:11:02.182275 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Mon Sep 19 12:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 (ip 10.222.0.78) !!! Sep 19 12:11:02.185740 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 19 12:11:02.185884 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Mon Sep 19 12:11:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.78) !!! Sep 19 12:11:02.192280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:02.192280 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:02.197113 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.197680 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-d802bba0-bdb9-4b06-a8f2-47dc578d304f req-312e61a6-3ae0-4cb0-942d-63f1c3f3633b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "891e6f35-aa05-434e-b112-67d10c65b655", "tag": "0acec94e-33b2-4493-8549-573a5c2a2791"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:11:02.197842 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.198374 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.199147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.199720 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.200213 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.215654 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d802bba0-bdb9-4b06-a8f2-47dc578d304f req-312e61a6-3ae0-4cb0-942d-63f1c3f3633b service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.216528 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d802bba0-bdb9-4b06-a8f2-47dc578d304f req-312e61a6-3ae0-4cb0-942d-63f1c3f3633b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.216966 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d802bba0-bdb9-4b06-a8f2-47dc578d304f req-312e61a6-3ae0-4cb0-942d-63f1c3f3633b service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.229273 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-d802bba0-bdb9-4b06-a8f2-47dc578d304f req-312e61a6-3ae0-4cb0-942d-63f1c3f3633b service nova] Creating event network-changed:0acec94e-33b2-4493-8549-573a5c2a2791 for instance 891e6f35-aa05-434e-b112-67d10c65b655 on hv-cinder-82282 Sep 19 12:11:02.229816 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:11:02.234881 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-d802bba0-bdb9-4b06-a8f2-47dc578d304f req-312e61a6-3ae0-4cb0-942d-63f1c3f3633b service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056374 Sep 19 12:11:02.235522 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1947/3864] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:02.602929 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-07d64cc6-7598-48da-9d68-423dbcb545fa tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 204 len: 0 microversion: 2.1 time: 0.426834 Sep 19 12:11:02.603947 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1918/3865] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:11:02 2022] DELETE /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:11:02.613313 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:02.614016 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:02.621867 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.622377 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.622817 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.623838 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:02.624455 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:02.625087 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:02.764885 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:02.773034 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-71115e55-f63c-4c6f-8428-59596dd1d8b1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1578 microversion: 2.1 time: 0.164469 Sep 19 12:11:02.773602 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1948/3866] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:02 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1578 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:03.798460 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:03.799283 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:03.805956 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:03.809806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:03.809806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:03.809806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:03.809806 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:03.810193 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:03.939391 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:03.947147 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-fde46dd0-b137-4443-8c1c-d8700159109d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1459 microversion: 2.1 time: 0.153758 Sep 19 12:11:03.947733 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1919/3867] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:03 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1459 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:04.701519 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-098d416d-c328-47c7-9933-9437eb55c1b0 req-abae8ff2-55e2-46f5-9c34-73f118e20589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "891e6f35-aa05-434e-b112-67d10c65b655", "name": "network-vif-deleted", "tag": "0acec94e-33b2-4493-8549-573a5c2a2791"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:11:04.711633 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-098d416d-c328-47c7-9933-9437eb55c1b0 req-abae8ff2-55e2-46f5-9c34-73f118e20589 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:04.712113 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-098d416d-c328-47c7-9933-9437eb55c1b0 req-abae8ff2-55e2-46f5-9c34-73f118e20589 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:04.712577 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-098d416d-c328-47c7-9933-9437eb55c1b0 req-abae8ff2-55e2-46f5-9c34-73f118e20589 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:04.724079 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-098d416d-c328-47c7-9933-9437eb55c1b0 req-abae8ff2-55e2-46f5-9c34-73f118e20589 service nova] Creating event network-vif-deleted:0acec94e-33b2-4493-8549-573a5c2a2791 for instance 891e6f35-aa05-434e-b112-67d10c65b655 on hv-cinder-82282 Sep 19 12:11:04.729094 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-098d416d-c328-47c7-9933-9437eb55c1b0 req-abae8ff2-55e2-46f5-9c34-73f118e20589 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031336 Sep 19 12:11:04.729749 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1949/3868] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:04.970848 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:04.971485 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:04.978316 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:04.978821 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:04.979291 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:04.979998 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:04.980457 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:04.980888 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:05.049095 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:05.057566 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-68a5fa6f-6bcf-4e0f-8311-fbd5fad997ba tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 200 len: 1225 microversion: 2.1 time: 0.091111 Sep 19 12:11:05.058155 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1920/3869] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:04 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:06.082681 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:06.083532 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 891e6f35-aa05-434e-b112-67d10c65b655] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:06.089576 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.093687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.093687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.093687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:06.093687 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:06.094166 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:06.105310 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] HTTP exception thrown: Instance 891e6f35-aa05-434e-b112-67d10c65b655 could not be found. Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Request method failure captured: Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 HTTP/1.1 Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFrOoaHCEs90XlrSpKoGu3_AIaiVGf83BGmlocJ_gEZwDpGkk7glPwIecYMIu1ETXKlkO9uiJTIEER_CFoVu2BVDb46EwZ_QrEayCobfMWm_5Yo6qkR9oaK2dPyXykuYjNgDgOjxUQSYJhj5anLoJztTBJoJulzXo-Oa1U248Xdh4mc Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:11:06.106956 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: ab1e5eb74e784f53a9250b9a7a2220c1 Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 891e6f35-aa05-434e-b112-67d10c65b655 could not be found. Sep 19 12:11:06.108307 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '891e6f35-aa05-434e-b112-67d10c65b655'} Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 891e6f35-aa05-434e-b112-67d10c65b655 could not be found. Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:11:06.112020 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 891e6f35-aa05-434e-b112-67d10c65b655 could not be found. Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 891e6f35-aa05-434e-b112-67d10c65b655 could not be found. Sep 19 12:11:06.113481 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:06.114542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Returning 404 to user: Instance 891e6f35-aa05-434e-b112-67d10c65b655 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:11:06.114542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-2869f9c3-4c54-498d-a41b-a3ad31c57c06 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655" status: 404 len: 111 microversion: 2.1 time: 0.030476 Sep 19 12:11:06.114542 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1950/3870] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:06 2022] GET /compute/v2.1/servers/891e6f35-aa05-434e-b112-67d10c65b655 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:11:09.458673 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:09.459749 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:09.460991 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-d21a35cc-aaf2-473f-b1f4-79568f0417d0 req-6f71e6d0-3205-4d36-a135-ee7b6a0a7d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3ddb9ed2-884b-4620-96ec-0b5a2ceca826", "tag": "bb94d8cf-b3d8-498a-98d2-cf530ab74f38"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:11:09.466015 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.466511 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.466949 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.467861 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.468324 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.468753 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.470853 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d21a35cc-aaf2-473f-b1f4-79568f0417d0 req-6f71e6d0-3205-4d36-a135-ee7b6a0a7d90 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.471353 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d21a35cc-aaf2-473f-b1f4-79568f0417d0 req-6f71e6d0-3205-4d36-a135-ee7b6a0a7d90 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.471784 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-d21a35cc-aaf2-473f-b1f4-79568f0417d0 req-6f71e6d0-3205-4d36-a135-ee7b6a0a7d90 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.483424 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-d21a35cc-aaf2-473f-b1f4-79568f0417d0 req-6f71e6d0-3205-4d36-a135-ee7b6a0a7d90 service nova] Creating event network-changed:bb94d8cf-b3d8-498a-98d2-cf530ab74f38 for instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 on hv-cinder-82282 Sep 19 12:11:09.488696 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-d21a35cc-aaf2-473f-b1f4-79568f0417d0 req-6f71e6d0-3205-4d36-a135-ee7b6a0a7d90 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031236 Sep 19 12:11:09.489527 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1951/3871] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 19 12:11:09.499565 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Going to try to terminate instance {{(pid=121085) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 19 12:11:09.828724 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-264a41d2-20bb-4265-826d-655ca2893c70 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 204 len: 0 microversion: 2.1 time: 0.371394 Sep 19 12:11:09.830250 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1921/3872] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:11:09 2022] DELETE /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 19 12:11:09.839013 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:09.839877 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:09.846472 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.846959 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.847417 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.848108 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:09.848559 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:09.848980 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:09.987114 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.policy [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121084) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:09.995141 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-7c182a8a-8815-4d02-ad42-42ec1e08c56d tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1576 microversion: 2.1 time: 0.160326 Sep 19 12:11:09.995753 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1952/3873] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:09 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 19 12:11:11.020223 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:11.020917 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:11.027323 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:11.027805 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:11.029135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:11.029135 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:11.029505 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:11.029918 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:11.164173 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:11.172166 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-56a58a77-c310-44b0-934a-e5e6c990f8bb tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1576 microversion: 2.1 time: 0.156368 Sep 19 12:11:11.172737 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1922/3874] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:11 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:11.797266 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [req-e4f5df9d-6b8d-4fc7-8ae6-003aeca05768 req-1106386c-ab09-4e89-bfa3-b3d804167e14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3ddb9ed2-884b-4620-96ec-0b5a2ceca826", "name": "network-vif-deleted", "tag": "bb94d8cf-b3d8-498a-98d2-cf530ab74f38"}]} {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 19 12:11:11.807606 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-e4f5df9d-6b8d-4fc7-8ae6-003aeca05768 req-1106386c-ab09-4e89-bfa3-b3d804167e14 service nova] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:11.808081 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-e4f5df9d-6b8d-4fc7-8ae6-003aeca05768 req-1106386c-ab09-4e89-bfa3-b3d804167e14 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:11.808511 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [req-e4f5df9d-6b8d-4fc7-8ae6-003aeca05768 req-1106386c-ab09-4e89-bfa3-b3d804167e14 service nova] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:11.823799 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.compute.server_external_events [req-e4f5df9d-6b8d-4fc7-8ae6-003aeca05768 req-1106386c-ab09-4e89-bfa3-b3d804167e14 service nova] Creating event network-vif-deleted:bb94d8cf-b3d8-498a-98d2-cf530ab74f38 for instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 on hv-cinder-82282 Sep 19 12:11:11.828761 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [req-e4f5df9d-6b8d-4fc7-8ae6-003aeca05768 req-1106386c-ab09-4e89-bfa3-b3d804167e14 service nova] 10.222.0.78 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035352 Sep 19 12:11:11.829911 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1953/3875] 10.222.0.78 () {64 vars in 1317 bytes} [Mon Sep 19 12:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 19 12:11:12.196461 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:12.205229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:12.205229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:12.205229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:12.205229 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:12.205719 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:12.205860 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:12.206295 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:12.273199 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.policy [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ab1e5eb74e784f53a9250b9a7a2220c1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7d811c8ed584ddb92b4642d85e8db00', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121085) authorize /opt/stack/nova/nova/policy.py:199}} Sep 19 12:11:12.280936 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-721fdecb-65a1-419b-9387-6c2066911604 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 200 len: 1224 microversion: 2.1 time: 0.088438 Sep 19 12:11:12.281517 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1923/3876] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:12 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 19 12:11:13.305988 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:13.306736 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 3ddb9ed2-884b-4620-96ec-0b5a2ceca826] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:13.312803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.317000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.317000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.317000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.317000 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.317328 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.328354 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] HTTP exception thrown: Instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 could not be found. Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Request method failure captured: Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 HTTP/1.1 Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFrOoaHCEs90XlrSpKoGu3_AIaiVGf83BGmlocJ_gEZwDpGkk7glPwIecYMIu1ETXKlkO9uiJTIEER_CFoVu2BVDb46EwZ_QrEayCobfMWm_5Yo6qkR9oaK2dPyXykuYjNgDgOjxUQSYJhj5anLoJztTBJoJulzXo-Oa1U248Xdh4mc Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:11:13.329986 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: ab1e5eb74e784f53a9250b9a7a2220c1 Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 could not be found. Sep 19 12:11:13.331454 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '3ddb9ed2-884b-4620-96ec-0b5a2ceca826'} Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 could not be found. Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:11:13.332272 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 could not be found. Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 could not be found. Sep 19 12:11:13.333586 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.334803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Returning 404 to user: Instance 3ddb9ed2-884b-4620-96ec-0b5a2ceca826 could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:11:13.334803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-8449a1a9-ed98-4e46-acbc-4a23af8f132e tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826" status: 404 len: 111 microversion: 2.1 time: 0.030257 Sep 19 12:11:13.334803 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1954/3877] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:13 2022] GET /compute/v2.1/servers/3ddb9ed2-884b-4620-96ec-0b5a2ceca826 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:11:13.882784 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:13.883388 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.compute.api [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121085) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:13.890743 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.891259 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.891723 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.892729 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.893158 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.893687 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG oslo_concurrency.lockutils [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121085) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.908230 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.wsgi [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] HTTP exception thrown: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Request method failure captured: Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: request: DELETE /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe HTTP/1.1 Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept: application/json Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Accept-Encoding: identity Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Connection: close Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Length: 0 Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Content-Type: application/json Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Host: 10.222.0.78 Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: Openstack-System-Scope: None Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: User-Agent: python-urllib3/1.26.12 Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Auth-Token: gAAAAABjKFrOoaHCEs90XlrSpKoGu3_AIaiVGf83BGmlocJ_gEZwDpGkk7glPwIecYMIu1ETXKlkO9uiJTIEER_CFoVu2BVDb46EwZ_QrEayCobfMWm_5Yo6qkR9oaK2dPyXykuYjNgDgOjxUQSYJhj5anLoJztTBJoJulzXo-Oa1U248Xdh4mc Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Id: None Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Domain-Name: None Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Identity-Status: Confirmed Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Is-Admin-Project: True Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Id: default Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Domain-Name: Default Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Project-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Role: reader,member Sep 19 12:11:13.909919 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Roles: reader,member Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-Tenant-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Id: default Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Domain-Name: Default Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Id: ab1e5eb74e784f53a9250b9a7a2220c1 Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: X-User-Name: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: method: > Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: exception: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.911397 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: action_args: {'id': '31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe'} Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:11:13.912232 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.913573 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.914925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Returning 404 to user: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. {{(pid=121085) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:11:13.914925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-b4ae57e9-4604-436f-a0cd-50cd14e20d18 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "DELETE /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 404 len: 111 microversion: 2.1 time: 0.033264 Sep 19 12:11:13.914925 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1924/3878] 10.222.0.78 () {58 vars in 1239 bytes} [Mon Sep 19 12:11:13 2022] DELETE /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:11:13.920402 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '>' {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:13.921021 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.compute.api [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] [instance: 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe] Fetching instance by UUID {{(pid=121084) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 19 12:11:13.927759 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.929981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.929981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.929981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Acquiring lock "8f81a8dc-976d-4306-9181-384261ba6896" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 19 12:11:13.929981 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 19 12:11:13.930340 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG oslo_concurrency.lockutils [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Lock "8f81a8dc-976d-4306-9181-384261ba6896" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121084) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 19 12:11:13.946247 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.wsgi [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] HTTP exception thrown: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Request method failure captured: Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: request: GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe HTTP/1.1 Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept: application/json Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Accept-Encoding: identity Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Connection: close Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Length: 0 Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Content-Type: application/json Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Host: 10.222.0.78 Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: Openstack-System-Scope: None Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: User-Agent: python-urllib3/1.26.12 Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Auth-Token: gAAAAABjKFrOoaHCEs90XlrSpKoGu3_AIaiVGf83BGmlocJ_gEZwDpGkk7glPwIecYMIu1ETXKlkO9uiJTIEER_CFoVu2BVDb46EwZ_QrEayCobfMWm_5Yo6qkR9oaK2dPyXykuYjNgDgOjxUQSYJhj5anLoJztTBJoJulzXo-Oa1U248Xdh4mc Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Id: None Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Domain-Name: None Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Identity-Status: Confirmed Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Is-Admin-Project: True Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Id: default Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Domain-Name: Default Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Project-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Role: reader,member Sep 19 12:11:13.947883 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Roles: reader,member Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/volume/v3/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.78:8080", "publicURL": "http://10.222.0.78:8080/v1/AUTH_b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/compute/v2/b7d811c8ed584ddb92b4642d85e8db00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/image"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.78/identity"}]}] Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Id: b7d811c8ed584ddb92b4642d85e8db00 Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-Tenant-Name: tempest-TestVolumeBootPattern-574546185 Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Id: default Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Domain-Name: Default Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Id: ab1e5eb74e784f53a9250b9a7a2220c1 Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: X-User-Name: tempest-TestVolumeBootPattern-574546185-project Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: method: > Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: exception: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.949337 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: action_args: {'id': '31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe'} Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: {{(pid=121084) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 19 12:11:13.950188 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. Sep 19 12:11:13.951537 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: ERROR nova.api.openstack.wsgi Sep 19 12:11:13.952939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: DEBUG nova.api.openstack.wsgi [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Returning 404 to user: Instance 31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe could not be found. {{(pid=121084) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 19 12:11:13.952939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: INFO nova.api.openstack.requestlog [None req-5afa99c7-95b1-41c0-af23-f2879317a8c0 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe" status: 404 len: 111 microversion: 2.1 time: 0.032895 Sep 19 12:11:13.952939 dv-cinder-822822-7-iscsi devstack@n-api.service[121084]: [pid: 121084|app: 0|req: 1955/3879] 10.222.0.78 () {58 vars in 1236 bytes} [Mon Sep 19 12:11:13 2022] GET /compute/v2.1/servers/31ebc712-0cb9-4e3c-963c-aa0dfdfdb3fe => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 19 12:11:15.474185 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: DEBUG nova.api.openstack.wsgi [None req-042a105c-1f3e-47dc-8af9-5cc3881eeaa1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] Calling method '.version_select at 0x7f4b9a3e4a60>' {{(pid=121085) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 19 12:11:15.558031 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: INFO nova.api.openstack.requestlog [None req-042a105c-1f3e-47dc-8af9-5cc3881eeaa1 tempest-TestVolumeBootPattern-574546185 tempest-TestVolumeBootPattern-574546185-project] 10.222.0.78 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-620718885" status: 202 len: 0 microversion: 2.1 time: 0.088078 Sep 19 12:11:15.558619 dv-cinder-822822-7-iscsi devstack@n-api.service[121085]: [pid: 121085|app: 0|req: 1925/3880] 10.222.0.78 () {58 vars in 1260 bytes} [Mon Sep 19 12:11:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-620718885 => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)